2026-01-06 00:18:30.645570 | Job console starting 2026-01-06 00:18:30.655945 | Updating git repos 2026-01-06 00:18:30.715982 | Cloning repos into workspace 2026-01-06 00:18:30.963079 | Restoring repo states 2026-01-06 00:18:30.984808 | Merging changes 2026-01-06 00:18:30.984833 | Checking out repos 2026-01-06 00:18:31.217486 | Preparing playbooks 2026-01-06 00:18:31.896774 | Running Ansible setup 2026-01-06 00:18:36.356417 | PRE-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/pre.yaml@main] 2026-01-06 00:18:37.169862 | 2026-01-06 00:18:37.170025 | PLAY [Base pre] 2026-01-06 00:18:37.198313 | 2026-01-06 00:18:37.198519 | TASK [Setup log path fact] 2026-01-06 00:18:37.221780 | orchestrator | ok 2026-01-06 00:18:37.241314 | 2026-01-06 00:18:37.241485 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-01-06 00:18:37.283967 | orchestrator | ok 2026-01-06 00:18:37.298177 | 2026-01-06 00:18:37.298319 | TASK [emit-job-header : Print job information] 2026-01-06 00:18:37.338278 | # Job Information 2026-01-06 00:18:37.338459 | Ansible Version: 2.16.14 2026-01-06 00:18:37.338493 | Job: testbed-upgrade-stable-rc-ubuntu-24.04 2026-01-06 00:18:37.338596 | Pipeline: periodic-midnight 2026-01-06 00:18:37.338626 | Executor: 521e9411259a 2026-01-06 00:18:37.338648 | Triggered by: https://github.com/osism/testbed 2026-01-06 00:18:37.338671 | Event ID: f117ecaaf4f04ac6b8eeb4c2eef15247 2026-01-06 00:18:37.345739 | 2026-01-06 00:18:37.345866 | LOOP [emit-job-header : Print node information] 2026-01-06 00:18:37.502920 | orchestrator | ok: 2026-01-06 00:18:37.503115 | orchestrator | # Node Information 2026-01-06 00:18:37.503149 | orchestrator | Inventory Hostname: orchestrator 2026-01-06 00:18:37.503192 | orchestrator | Hostname: zuul-static-regiocloud-infra-1 2026-01-06 00:18:37.503216 | orchestrator | Username: zuul-testbed04 2026-01-06 00:18:37.503237 | orchestrator | Distro: Debian 12.12 2026-01-06 00:18:37.503261 | orchestrator | Provider: static-testbed 2026-01-06 00:18:37.503283 | orchestrator | Region: 2026-01-06 00:18:37.503304 | orchestrator | Label: testbed-orchestrator 2026-01-06 00:18:37.503323 | orchestrator | Product Name: OpenStack Nova 2026-01-06 00:18:37.503343 | orchestrator | Interface IP: 81.163.193.140 2026-01-06 00:18:37.525905 | 2026-01-06 00:18:37.526089 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-01-06 00:18:38.083695 | orchestrator -> localhost | changed 2026-01-06 00:18:38.092234 | 2026-01-06 00:18:38.092375 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-01-06 00:18:39.350936 | orchestrator -> localhost | changed 2026-01-06 00:18:39.366245 | 2026-01-06 00:18:39.366383 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-01-06 00:18:39.740493 | orchestrator -> localhost | ok 2026-01-06 00:18:39.756975 | 2026-01-06 00:18:39.757328 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-01-06 00:18:39.790691 | orchestrator | ok 2026-01-06 00:18:39.809503 | orchestrator | included: /var/lib/zuul/builds/f24b723acca84f8b88b44841d6858cde/trusted/project_1/github.com/osism/openinfra-zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-01-06 00:18:39.820141 | 2026-01-06 00:18:39.820312 | TASK [add-build-sshkey : Create Temp SSH key] 2026-01-06 00:18:41.274339 | orchestrator -> localhost | Generating public/private rsa key pair. 2026-01-06 00:18:41.274572 | orchestrator -> localhost | Your identification has been saved in /var/lib/zuul/builds/f24b723acca84f8b88b44841d6858cde/work/f24b723acca84f8b88b44841d6858cde_id_rsa 2026-01-06 00:18:41.274615 | orchestrator -> localhost | Your public key has been saved in /var/lib/zuul/builds/f24b723acca84f8b88b44841d6858cde/work/f24b723acca84f8b88b44841d6858cde_id_rsa.pub 2026-01-06 00:18:41.274644 | orchestrator -> localhost | The key fingerprint is: 2026-01-06 00:18:41.274669 | orchestrator -> localhost | SHA256:iEDzq7EAskG8VnP0xjLYPZOq7VBmCkNfBh6lTrS+qtg zuul-build-sshkey 2026-01-06 00:18:41.274692 | orchestrator -> localhost | The key's randomart image is: 2026-01-06 00:18:41.274726 | orchestrator -> localhost | +---[RSA 3072]----+ 2026-01-06 00:18:41.274748 | orchestrator -> localhost | |..o+oo | 2026-01-06 00:18:41.274774 | orchestrator -> localhost | |.oo=B.+ . | 2026-01-06 00:18:41.274795 | orchestrator -> localhost | |+.+*+* O | 2026-01-06 00:18:41.274816 | orchestrator -> localhost | |+==.oo=.o | 2026-01-06 00:18:41.275055 | orchestrator -> localhost | |+o.+o=. S | 2026-01-06 00:18:41.275109 | orchestrator -> localhost | | .o+O | 2026-01-06 00:18:41.275137 | orchestrator -> localhost | | o= . | 2026-01-06 00:18:41.275205 | orchestrator -> localhost | |... o | 2026-01-06 00:18:41.275232 | orchestrator -> localhost | |+.E . | 2026-01-06 00:18:41.275253 | orchestrator -> localhost | +----[SHA256]-----+ 2026-01-06 00:18:41.275317 | orchestrator -> localhost | ok: Runtime: 0:00:00.914109 2026-01-06 00:18:41.290121 | 2026-01-06 00:18:41.290294 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-01-06 00:18:41.322371 | orchestrator | ok 2026-01-06 00:18:41.333027 | orchestrator | included: /var/lib/zuul/builds/f24b723acca84f8b88b44841d6858cde/trusted/project_1/github.com/osism/openinfra-zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-01-06 00:18:41.343185 | 2026-01-06 00:18:41.343319 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-01-06 00:18:41.367905 | orchestrator | skipping: Conditional result was False 2026-01-06 00:18:41.376421 | 2026-01-06 00:18:41.376555 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-01-06 00:18:42.129023 | orchestrator | changed 2026-01-06 00:18:42.139597 | 2026-01-06 00:18:42.139829 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-01-06 00:18:42.441448 | orchestrator | ok 2026-01-06 00:18:42.453297 | 2026-01-06 00:18:42.453432 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-01-06 00:18:42.939698 | orchestrator | ok 2026-01-06 00:18:42.972612 | 2026-01-06 00:18:42.972805 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-01-06 00:18:43.577649 | orchestrator | ok 2026-01-06 00:18:43.590224 | 2026-01-06 00:18:43.590365 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-01-06 00:18:43.645369 | orchestrator | skipping: Conditional result was False 2026-01-06 00:18:43.653304 | 2026-01-06 00:18:43.653458 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-01-06 00:18:44.859989 | orchestrator -> localhost | changed 2026-01-06 00:18:44.880436 | 2026-01-06 00:18:44.880576 | TASK [add-build-sshkey : Add back temp key] 2026-01-06 00:18:45.457637 | orchestrator -> localhost | Identity added: /var/lib/zuul/builds/f24b723acca84f8b88b44841d6858cde/work/f24b723acca84f8b88b44841d6858cde_id_rsa (zuul-build-sshkey) 2026-01-06 00:18:45.457893 | orchestrator -> localhost | ok: Runtime: 0:00:00.012083 2026-01-06 00:18:45.466019 | 2026-01-06 00:18:45.466181 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-01-06 00:18:45.941926 | orchestrator | ok 2026-01-06 00:18:45.949866 | 2026-01-06 00:18:45.950021 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-01-06 00:18:45.975110 | orchestrator | skipping: Conditional result was False 2026-01-06 00:18:46.039119 | 2026-01-06 00:18:46.039809 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-01-06 00:18:46.486109 | orchestrator | ok 2026-01-06 00:18:46.501337 | 2026-01-06 00:18:46.501537 | TASK [validate-host : Define zuul_info_dir fact] 2026-01-06 00:18:46.532575 | orchestrator | ok 2026-01-06 00:18:46.542136 | 2026-01-06 00:18:46.542330 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-01-06 00:18:47.301728 | orchestrator -> localhost | ok 2026-01-06 00:18:47.310149 | 2026-01-06 00:18:47.310310 | TASK [validate-host : Collect information about the host] 2026-01-06 00:18:48.972908 | orchestrator | ok 2026-01-06 00:18:48.988062 | 2026-01-06 00:18:48.988223 | TASK [validate-host : Sanitize hostname] 2026-01-06 00:18:49.069140 | orchestrator | ok 2026-01-06 00:18:49.077215 | 2026-01-06 00:18:49.077366 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-01-06 00:18:50.138752 | orchestrator -> localhost | changed 2026-01-06 00:18:50.145876 | 2026-01-06 00:18:50.146009 | TASK [validate-host : Collect information about zuul worker] 2026-01-06 00:18:50.828195 | orchestrator | ok 2026-01-06 00:18:50.849911 | 2026-01-06 00:18:50.850061 | TASK [validate-host : Write out all zuul information for each host] 2026-01-06 00:18:51.875648 | orchestrator -> localhost | changed 2026-01-06 00:18:51.888190 | 2026-01-06 00:18:51.888325 | TASK [prepare-workspace-log : Start zuul_console daemon.] 2026-01-06 00:18:52.202704 | orchestrator | ok 2026-01-06 00:18:52.209488 | 2026-01-06 00:18:52.209620 | TASK [prepare-workspace-log : Synchronize src repos to workspace directory.] 2026-01-06 00:19:32.807270 | orchestrator | changed: 2026-01-06 00:19:32.807505 | orchestrator | .d..t...... src/ 2026-01-06 00:19:32.807700 | orchestrator | .d..t...... src/github.com/ 2026-01-06 00:19:32.807730 | orchestrator | .d..t...... src/github.com/osism/ 2026-01-06 00:19:32.807753 | orchestrator | .d..t...... src/github.com/osism/ansible-collection-commons/ 2026-01-06 00:19:32.807773 | orchestrator | RedHat.yml 2026-01-06 00:19:32.825056 | orchestrator | .L..t...... src/github.com/osism/ansible-collection-commons/roles/repository/tasks/CentOS.yml -> RedHat.yml 2026-01-06 00:19:32.825073 | orchestrator | RedHat.yml 2026-01-06 00:19:32.825125 | orchestrator | localhost | ok: "/var/lib/zuul/builds/f24b723acca84f8b88b44841d6858cde/work/logs" 2026-01-06 00:19:58.297585 | orchestrator -> localhost | changed: "/var/lib/zuul/builds/f24b723acca84f8b88b44841d6858cde/work/artifacts" 2026-01-06 00:19:58.573832 | orchestrator -> localhost | changed: "/var/lib/zuul/builds/f24b723acca84f8b88b44841d6858cde/work/docs" 2026-01-06 00:19:58.586261 | 2026-01-06 00:19:58.586396 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-01-06 00:19:59.542231 | orchestrator | changed: .d..t...... ./ 2026-01-06 00:19:59.542573 | orchestrator | changed: All items complete 2026-01-06 00:19:59.542635 | 2026-01-06 00:20:00.427040 | orchestrator | changed: .d..t...... ./ 2026-01-06 00:20:01.260407 | orchestrator | changed: .d..t...... ./ 2026-01-06 00:20:01.287050 | 2026-01-06 00:20:01.287246 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-01-06 00:20:01.314027 | orchestrator | skipping: Conditional result was False 2026-01-06 00:20:01.320524 | orchestrator | skipping: Conditional result was False 2026-01-06 00:20:01.330086 | 2026-01-06 00:20:01.330218 | PLAY RECAP 2026-01-06 00:20:01.330278 | orchestrator | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-01-06 00:20:01.330306 | 2026-01-06 00:20:01.481413 | POST-RUN END RESULT_NORMAL: [trusted : github.com/osism/zuul-config/playbooks/base/post-fetch.yaml@main] 2026-01-06 00:20:01.483803 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post.yaml@main] 2026-01-06 00:20:02.393408 | 2026-01-06 00:20:02.393573 | PLAY [Base post] 2026-01-06 00:20:02.410381 | 2026-01-06 00:20:02.410548 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-01-06 00:20:03.072632 | orchestrator | changed 2026-01-06 00:20:03.081384 | 2026-01-06 00:20:03.081525 | PLAY RECAP 2026-01-06 00:20:03.081592 | orchestrator | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-01-06 00:20:03.081654 | 2026-01-06 00:20:03.253452 | POST-RUN END RESULT_NORMAL: [trusted : github.com/osism/zuul-config/playbooks/base/post.yaml@main] 2026-01-06 00:20:03.254512 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post-logs.yaml@main] 2026-01-06 00:20:04.124216 | 2026-01-06 00:20:04.124412 | PLAY [Base post-logs] 2026-01-06 00:20:04.136163 | 2026-01-06 00:20:04.136372 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-01-06 00:20:04.741965 | localhost | changed 2026-01-06 00:20:04.764808 | 2026-01-06 00:20:04.765015 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-01-06 00:20:04.862545 | localhost | ok 2026-01-06 00:20:04.865893 | 2026-01-06 00:20:04.866004 | TASK [Set zuul-log-path fact] 2026-01-06 00:20:04.893792 | localhost | ok 2026-01-06 00:20:04.935346 | 2026-01-06 00:20:04.935500 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-01-06 00:20:04.962106 | localhost | ok 2026-01-06 00:20:04.967006 | 2026-01-06 00:20:04.967216 | TASK [upload-logs : Create log directories] 2026-01-06 00:20:05.611165 | localhost | changed 2026-01-06 00:20:05.614117 | 2026-01-06 00:20:05.614255 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-01-06 00:20:06.184486 | localhost -> localhost | ok: Runtime: 0:00:00.005195 2026-01-06 00:20:06.188645 | 2026-01-06 00:20:06.188771 | TASK [upload-logs : Upload logs to log server] 2026-01-06 00:20:06.786451 | localhost | Output suppressed because no_log was given 2026-01-06 00:20:06.788665 | 2026-01-06 00:20:06.788784 | LOOP [upload-logs : Compress console log and json output] 2026-01-06 00:20:06.853807 | localhost | skipping: Conditional result was False 2026-01-06 00:20:06.861386 | localhost | skipping: Conditional result was False 2026-01-06 00:20:06.874475 | 2026-01-06 00:20:06.874618 | LOOP [upload-logs : Upload compressed console log and json output] 2026-01-06 00:20:06.938095 | localhost | skipping: Conditional result was False 2026-01-06 00:20:06.938395 | 2026-01-06 00:20:06.943426 | localhost | skipping: Conditional result was False 2026-01-06 00:20:06.950308 | 2026-01-06 00:20:06.950524 | LOOP [upload-logs : Upload console log and json output]