2026-03-07T01:28:49.744 INFO:root:teuthology version: 1.2.4.dev6+g1c580df7a 2026-03-07T01:28:49.750 DEBUG:teuthology.report:Pushing job info to http://localhost:8080 2026-03-07T01:28:49.770 INFO:teuthology.run:Config: archive_path: /archive/irq0-2026-03-06_21:40:09-rgw-cobaltcore-storage-v19.2.3-fasttrack-5-none-default-vps/439 branch: cobaltcore-storage-v19.2.3-fasttrack-5 description: rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides rocky_latest s3tests-branch tasks/s3/{auth-order/external-local s3tests}} email: null first_in_suite: false flavor: default job_id: '439' last_in_suite: false machine_type: vps name: irq0-2026-03-06_21:40:09-rgw-cobaltcore-storage-v19.2.3-fasttrack-5-none-default-vps no_nested_subset: false os_type: rocky os_version: '9.7' overrides: admin_socket: branch: cobaltcore-storage-v19.2.3-fasttrack-5 ansible.cephlab: branch: main repo: https://github.com/kshtsk/ceph-cm-ansible.git skip_tags: nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs vars: timezone: Europe/Berlin ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw keystone accepted admin roles: admin rgw keystone accepted roles: admin,member rgw keystone admin domain: Default rgw keystone admin password: ADMIN rgw keystone admin project: admin rgw keystone admin user: admin rgw keystone api version: 3 rgw keystone implicit tenants: true rgw s3 auth order: sts, external, local rgw s3 auth use keystone: true rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw swift account in url: true rgw swift enforce content length: true rgw swift versioning enabled: true setgroup: ceph setuser: ceph global: osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd mclock iops capacity threshold hdd: 49000 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 340d3c24fc6ae7529322dc7ccee6c6cb2589da0a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} cephadm: cephadm_binary_url: https://download.ceph.com/rpm-19.2.3/el9/noarch/cephadm containers: image: harbor.clyso.com/custom-ceph/ceph/ceph:cobaltcore-storage-v19.2.3-fasttrack-5 install: ceph: flavor: default sha1: 340d3c24fc6ae7529322dc7ccee6c6cb2589da0a extra_system_packages: deb: - python3-xmltodict - s3cmd rpm: - bzip2 - perl-Test-Harness - python3-xmltodict - s3cmd repos: - name: ceph-source priority: 1 url: https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/SRPMS - name: ceph-noarch priority: 1 url: https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/noarch - name: ceph priority: 1 url: https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/x86_64 keystone: client.0: ec2 credentials: - project: s3tests user: s3tests-main projects: - description: s3tests project name: s3tests role-mappings: - name: member project: s3tests user: s3tests-main roles: - name: member users: - name: s3tests-main password: SECRET project: s3tests rgw: frontend: beast s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 force-branch: ceph-squid selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: tt-fasttrack-5-kafka sha1: de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0 owner: irq0 priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 8950 sha1: 340d3c24fc6ae7529322dc7ccee6c6cb2589da0a sleep_before_teardown: 0 suite: rgw suite_branch: tt-fasttrack-5-kafka suite_path: /home/teuthos/src/github.com_kshtsk_ceph_de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0/qa suite_relpath: qa suite_repo: https://github.com/kshtsk/ceph.git suite_sha1: de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0 targets: vm07.local: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIbObpm0EnTiZ2Z7WgHw3cs6JKnne74BItP0pjr4YhxsJQpjYIa/9cksWkVBGp4mqSRoiorliECpmM3e3cBK/mA= tasks: - install: null - ceph: null - tox: - client.0 - keystone: client.0: force-branch: stable/2025.1 services: - description: Swift Service name: swift type: object-store - rgw: client.0: use-keystone-role: client.0 - s3tests: client.0: keystone users: s3 main: client: client.0 project: s3tests user: s3tests-main rgw_server: client.0 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: clyso-debian-13 teuthology_repo: https://github.com/clyso/teuthology teuthology_sha1: 1c580df7a9c7c2aadc272da296344fd99f27c444 timestamp: 2026-03-06_21:40:09 tube: vps user: irq0 verbose: false worker_log: /home/teuthos/.teuthology/dispatcher/dispatcher.vps.43333 2026-03-07T01:28:49.770 INFO:teuthology.run:suite_path is set to /home/teuthos/src/github.com_kshtsk_ceph_de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0/qa; will attempt to use it 2026-03-07T01:28:49.771 INFO:teuthology.run:Found tasks at /home/teuthos/src/github.com_kshtsk_ceph_de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0/qa/tasks 2026-03-07T01:28:49.771 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-03-07T01:28:49.771 INFO:teuthology.task.internal:Saving configuration 2026-03-07T01:28:49.777 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-03-07T01:28:49.777 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-03-07T01:28:49.783 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'vm07.local', 'description': '/archive/irq0-2026-03-06_21:40:09-rgw-cobaltcore-storage-v19.2.3-fasttrack-5-none-default-vps/439', 'up': True, 'machine_type': 'vps', 'is_vm': True, 'vm_host': {'name': 'localhost', 'description': None, 'up': True, 'machine_type': 'libvirt', 'is_vm': False, 'vm_host': None, 'os_type': None, 'os_version': None, 'arch': None, 'locked': True, 'locked_since': None, 'locked_by': None, 'mac_address': None, 'ssh_pub_key': None}, 'os_type': 'rocky', 'os_version': '9.7', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-03-07 00:28:07.438165', 'locked_by': 'irq0', 'mac_address': '52:55:00:00:00:07', 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIbObpm0EnTiZ2Z7WgHw3cs6JKnne74BItP0pjr4YhxsJQpjYIa/9cksWkVBGp4mqSRoiorliECpmM3e3cBK/mA='} 2026-03-07T01:28:49.783 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-03-07T01:28:49.784 INFO:teuthology.task.internal:roles: ubuntu@vm07.local - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-03-07T01:28:49.784 INFO:teuthology.run_tasks:Running task console_log... 2026-03-07T01:28:49.790 DEBUG:teuthology.task.console_log:vm07 does not support IPMI; excluding 2026-03-07T01:28:49.790 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe5eafdbf40>, signals=[15]) 2026-03-07T01:28:49.790 INFO:teuthology.run_tasks:Running task internal.connect... 2026-03-07T01:28:49.791 INFO:teuthology.task.internal:Opening connections... 2026-03-07T01:28:49.791 DEBUG:teuthology.task.internal:connecting to ubuntu@vm07.local 2026-03-07T01:28:49.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm07.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-07T01:28:49.854 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-03-07T01:28:49.855 DEBUG:teuthology.orchestra.run.vm07:> uname -m 2026-03-07T01:28:50.008 INFO:teuthology.orchestra.run.vm07.stdout:x86_64 2026-03-07T01:28:50.008 DEBUG:teuthology.orchestra.run.vm07:> cat /etc/os-release 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:NAME="Rocky Linux" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:VERSION="9.7 (Blue Onyx)" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:ID="rocky" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:ID_LIKE="rhel centos fedora" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:VERSION_ID="9.7" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:PLATFORM_ID="platform:el9" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:PRETTY_NAME="Rocky Linux 9.7 (Blue Onyx)" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:ANSI_COLOR="0;32" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:LOGO="fedora-logo-icon" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:CPE_NAME="cpe:/o:rocky:rocky:9::baseos" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:HOME_URL="https://rockylinux.org/" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:VENDOR_NAME="RESF" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:VENDOR_URL="https://resf.org/" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:SUPPORT_END="2032-05-31" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-9" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="9.7" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-03-07T01:28:50.064 INFO:teuthology.orchestra.run.vm07.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="9.7" 2026-03-07T01:28:50.064 INFO:teuthology.lock.ops:Updating vm07.local on lock server 2026-03-07T01:28:50.069 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-03-07T01:28:50.070 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-03-07T01:28:50.071 INFO:teuthology.task.internal:Checking for old test directory... 2026-03-07T01:28:50.071 DEBUG:teuthology.orchestra.run.vm07:> test '!' -e /home/ubuntu/cephtest 2026-03-07T01:28:50.118 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-03-07T01:28:50.119 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-03-07T01:28:50.120 DEBUG:teuthology.orchestra.run.vm07:> test -z $(ls -A /var/lib/ceph) 2026-03-07T01:28:50.174 INFO:teuthology.orchestra.run.vm07.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-03-07T01:28:50.174 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-03-07T01:28:50.182 DEBUG:teuthology.orchestra.run.vm07:> test -e /ceph-qa-ready 2026-03-07T01:28:50.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-07T01:28:50.419 INFO:teuthology.run_tasks:Running task internal.base... 2026-03-07T01:28:50.420 INFO:teuthology.task.internal:Creating test directory... 2026-03-07T01:28:50.420 DEBUG:teuthology.orchestra.run.vm07:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-03-07T01:28:50.434 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-03-07T01:28:50.435 INFO:teuthology.run_tasks:Running task internal.archive... 2026-03-07T01:28:50.436 INFO:teuthology.task.internal:Creating archive directory... 2026-03-07T01:28:50.436 DEBUG:teuthology.orchestra.run.vm07:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-03-07T01:28:50.494 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-03-07T01:28:50.495 INFO:teuthology.task.internal:Enabling coredump saving... 2026-03-07T01:28:50.496 DEBUG:teuthology.orchestra.run.vm07:> test -f /run/.containerenv -o -f /.dockerenv 2026-03-07T01:28:50.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-07T01:28:50.550 DEBUG:teuthology.orchestra.run.vm07:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-03-07T01:28:50.618 INFO:teuthology.orchestra.run.vm07.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-07T01:28:50.627 INFO:teuthology.orchestra.run.vm07.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-07T01:28:50.628 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-03-07T01:28:50.629 INFO:teuthology.task.internal:Configuring sudo... 2026-03-07T01:28:50.630 DEBUG:teuthology.orchestra.run.vm07:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-03-07T01:28:50.693 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-03-07T01:28:50.695 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-03-07T01:28:50.696 DEBUG:teuthology.orchestra.run.vm07:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-03-07T01:28:50.749 DEBUG:teuthology.orchestra.run.vm07:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-07T01:28:50.813 DEBUG:teuthology.orchestra.run.vm07:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-07T01:28:50.871 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:28:50.872 DEBUG:teuthology.orchestra.run.vm07:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-03-07T01:28:50.929 DEBUG:teuthology.orchestra.run.vm07:> sudo service rsyslog restart 2026-03-07T01:28:51.001 INFO:teuthology.orchestra.run.vm07.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-07T01:28:51.342 INFO:teuthology.run_tasks:Running task internal.timer... 2026-03-07T01:28:51.344 INFO:teuthology.task.internal:Starting timer... 2026-03-07T01:28:51.344 INFO:teuthology.run_tasks:Running task pcp... 2026-03-07T01:28:51.346 INFO:teuthology.run_tasks:Running task selinux... 2026-03-07T01:28:51.348 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-03-07T01:28:51.348 INFO:teuthology.task.selinux:Excluding vm07: VMs are not yet supported 2026-03-07T01:28:51.349 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-03-07T01:28:51.349 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-03-07T01:28:51.349 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-03-07T01:28:51.349 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-03-07T01:28:51.350 DEBUG:teuthology.task:Applying overrides for task ansible.cephlab: {'branch': 'main', 'repo': 'https://github.com/kshtsk/ceph-cm-ansible.git', 'skip_tags': 'nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs', 'vars': {'timezone': 'Europe/Berlin'}} 2026-03-07T01:28:51.351 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthos/src/github.com_kshtsk_ceph-cm-ansible_main to origin/main 2026-03-07T01:28:51.357 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-03-07T01:28:51.357 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu", "timezone": "Europe/Berlin"}' -i /tmp/teuth_ansible_inventoryv_ec339r --limit vm07.local /home/teuthos/src/github.com_kshtsk_ceph-cm-ansible_main/cephlab.yml --skip-tags nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs 2026-03-07T01:31:17.867 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@vm07.local')] 2026-03-07T01:31:17.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@vm07.local' 2026-03-07T01:31:17.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm07.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-07T01:31:17.937 DEBUG:teuthology.orchestra.run.vm07:> true 2026-03-07T01:31:18.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@vm07.local' 2026-03-07T01:31:18.016 INFO:teuthology.run_tasks:Running task clock... 2026-03-07T01:31:18.019 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-03-07T01:31:18.019 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-03-07T01:31:18.019 DEBUG:teuthology.orchestra.run.vm07:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-07T01:31:18.095 INFO:teuthology.orchestra.run.vm07.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-03-07T01:31:18.114 INFO:teuthology.orchestra.run.vm07.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-03-07T01:31:18.150 INFO:teuthology.orchestra.run.vm07.stderr:sudo: ntpd: command not found 2026-03-07T01:31:18.167 INFO:teuthology.orchestra.run.vm07.stdout:506 Cannot talk to daemon 2026-03-07T01:31:18.185 INFO:teuthology.orchestra.run.vm07.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-03-07T01:31:18.200 INFO:teuthology.orchestra.run.vm07.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-03-07T01:31:18.260 INFO:teuthology.orchestra.run.vm07.stderr:bash: line 1: ntpq: command not found 2026-03-07T01:31:18.266 INFO:teuthology.orchestra.run.vm07.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-07T01:31:18.266 INFO:teuthology.orchestra.run.vm07.stdout:=============================================================================== 2026-03-07T01:31:18.266 INFO:teuthology.orchestra.run.vm07.stdout:^? 104-167-24-26.lunoxia.fc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-07T01:31:18.266 INFO:teuthology.orchestra.run.vm07.stdout:^? sv1.ggsrv.de 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-07T01:31:18.266 INFO:teuthology.orchestra.run.vm07.stdout:^? where-you.at 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-07T01:31:18.266 INFO:teuthology.orchestra.run.vm07.stdout:^? 172-236-195-26.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-07T01:31:18.267 INFO:teuthology.run_tasks:Running task install... 2026-03-07T01:31:18.268 DEBUG:teuthology.task.install:project ceph 2026-03-07T01:31:18.268 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '340d3c24fc6ae7529322dc7ccee6c6cb2589da0a'}, 'extra_system_packages': {'deb': ['python3-xmltodict', 's3cmd'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 's3cmd']}, 'repos': [{'name': 'ceph-source', 'priority': 1, 'url': 'https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/SRPMS'}, {'name': 'ceph-noarch', 'priority': 1, 'url': 'https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/noarch'}, {'name': 'ceph', 'priority': 1, 'url': 'https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/x86_64'}]} 2026-03-07T01:31:18.268 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '340d3c24fc6ae7529322dc7ccee6c6cb2589da0a', 'extra_system_packages': {'deb': ['python3-xmltodict', 's3cmd'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 's3cmd']}} 2026-03-07T01:31:18.268 INFO:teuthology.task.install:Using flavor: default 2026-03-07T01:31:18.271 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-03-07T01:31:18.271 INFO:teuthology.task.install:extra packages: [] 2026-03-07T01:31:18.271 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['python3-xmltodict', 's3cmd'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 's3cmd']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '340d3c24fc6ae7529322dc7ccee6c6cb2589da0a', 'tag': None, 'wait_for_package': False, 'repos': [{'name': 'ceph-source', 'priority': 1, 'url': 'https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/SRPMS'}, {'name': 'ceph-noarch', 'priority': 1, 'url': 'https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/noarch'}, {'name': 'ceph', 'priority': 1, 'url': 'https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/x86_64'}]} 2026-03-07T01:31:18.271 DEBUG:teuthology.task.install.rpm:Adding repos: [{'name': 'ceph-source', 'priority': 1, 'url': 'https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/SRPMS'}, {'name': 'ceph-noarch', 'priority': 1, 'url': 'https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/noarch'}, {'name': 'ceph', 'priority': 1, 'url': 'https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/x86_64'}] 2026-03-07T01:31:18.271 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:31:18.271 DEBUG:teuthology.orchestra.run.vm07:> sudo dd of=/etc/yum.repos.d/ceph-source.repo 2026-03-07T01:31:18.349 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:31:18.349 DEBUG:teuthology.orchestra.run.vm07:> sudo dd of=/etc/yum.repos.d/ceph-noarch.repo 2026-03-07T01:31:18.429 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:31:18.429 DEBUG:teuthology.orchestra.run.vm07:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-03-07T01:31:18.505 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bzip2, perl-Test-Harness, python3-xmltodict, s3cmd on remote rpm x86_64 2026-03-07T01:31:18.505 DEBUG:teuthology.orchestra.run.vm07:> sudo yum clean all 2026-03-07T01:31:18.724 INFO:teuthology.orchestra.run.vm07.stdout:47 files removed 2026-03-07T01:31:18.750 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bzip2 perl-Test-Harness python3-xmltodict s3cmd 2026-03-07T01:31:19.206 INFO:teuthology.orchestra.run.vm07.stdout:ceph 373 kB/s | 86 kB 00:00 2026-03-07T01:31:19.491 INFO:teuthology.orchestra.run.vm07.stdout:ceph-noarch 46 kB/s | 12 kB 00:00 2026-03-07T01:31:19.687 INFO:teuthology.orchestra.run.vm07.stdout:ceph-source 13 kB/s | 2.2 kB 00:00 2026-03-07T01:31:20.534 INFO:teuthology.orchestra.run.vm07.stdout:Extra Packages for Enterprise Linux 25 MB/s | 20 MB 00:00 2026-03-07T01:31:26.211 INFO:teuthology.orchestra.run.vm07.stdout:lab-extras 64 kB/s | 50 kB 00:00 2026-03-07T01:31:28.680 INFO:teuthology.orchestra.run.vm07.stdout:Rocky Linux 9 - BaseOS 6.7 MB/s | 16 MB 00:02 2026-03-07T01:31:33.012 INFO:teuthology.orchestra.run.vm07.stdout:Rocky Linux 9 - AppStream 5.5 MB/s | 16 MB 00:02 2026-03-07T01:31:37.238 INFO:teuthology.orchestra.run.vm07.stdout:Rocky Linux 9 - CRB 1.8 MB/s | 4.1 MB 00:02 2026-03-07T01:31:39.261 INFO:teuthology.orchestra.run.vm07.stdout:Rocky Linux 9 - Extras 12 kB/s | 17 kB 00:01 2026-03-07T01:31:40.481 INFO:teuthology.orchestra.run.vm07.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-03-07T01:31:40.482 INFO:teuthology.orchestra.run.vm07.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-03-07T01:31:40.506 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:31:40.511 INFO:teuthology.orchestra.run.vm07.stdout:============================================================================================== 2026-03-07T01:31:40.511 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:31:40.511 INFO:teuthology.orchestra.run.vm07.stdout:============================================================================================== 2026-03-07T01:31:40.511 INFO:teuthology.orchestra.run.vm07.stdout:Installing: 2026-03-07T01:31:40.511 INFO:teuthology.orchestra.run.vm07.stdout: bzip2 x86_64 1.0.8-10.el9_5 baseos 51 k 2026-03-07T01:31:40.511 INFO:teuthology.orchestra.run.vm07.stdout: ceph x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 6.5 k 2026-03-07T01:31:40.511 INFO:teuthology.orchestra.run.vm07.stdout: ceph-base x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 5.5 M 2026-03-07T01:31:40.511 INFO:teuthology.orchestra.run.vm07.stdout: ceph-fuse x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 1.1 M 2026-03-07T01:31:40.511 INFO:teuthology.orchestra.run.vm07.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 145 k 2026-03-07T01:31:40.511 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 1.1 M 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-cephadm noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph-noarch 150 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-dashboard noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph-noarch 3.8 M 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph-noarch 7.4 M 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-rook noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph-noarch 49 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-radosgw x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 11 M 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-test x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 50 M 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-volume noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph-noarch 299 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: cephadm noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph-noarch 769 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: libcephfs-devel x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 34 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: libcephfs2 x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 998 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: librados-devel x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 126 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: perl-Test-Harness noarch 1:3.42-461.el9 appstream 267 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: python3-cephfs x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 165 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: python3-rados x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 322 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: python3-rbd x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 302 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: python3-rgw x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 100 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: rbd-fuse x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 85 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: rbd-mirror x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 3.1 M 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: rbd-nbd x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 170 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout:Upgrading: 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: librados2 x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 3.4 M 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: librbd1 x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 3.2 M 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout:Installing dependencies: 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: boost-program-options x86_64 1.75.0-13.el9_7 appstream 104 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: c-ares x86_64 1.19.1-2.el9_4 baseos 110 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-common x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 22 M 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-grafana-dashboards noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph-noarch 31 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mds x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 2.4 M 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-modules-core noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph-noarch 252 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mon x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 4.7 M 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-osd x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 17 M 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-prometheus-alerts noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph-noarch 16 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: ceph-selinux x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 25 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: cryptsetup x86_64 2.7.2-4.el9 baseos 310 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: flexiblas x86_64 3.0.4-8.el9.0.1 appstream 30 k 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: flexiblas-netlib x86_64 3.0.4-8.el9.0.1 appstream 3.0 M 2026-03-07T01:31:40.512 INFO:teuthology.orchestra.run.vm07.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9.0.1 appstream 15 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: fuse x86_64 2.9.9-17.el9 baseos 78 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 41 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: libcephsqlite x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 163 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: libconfig x86_64 1.7.2-9.el9 baseos 71 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: libgfortran x86_64 11.5.0-11.el9 baseos 794 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: libnbd x86_64 1.20.3-4.el9 appstream 171 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 159 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: libquadmath x86_64 11.5.0-11.el9 baseos 184 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 44 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: libradosstriper1 x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 504 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: librgw2 x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 5.4 M 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 243 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: libxslt x86_64 1.1.34-13.el9_6 appstream 239 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: lmdb-libs x86_64 0.9.29-3.el9 baseos 60 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 282 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: lua x86_64 5.4.4-4.el9 appstream 187 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: lua-devel x86_64 5.4.4-4.el9 crb 21 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: mailcap noarch 2.1.49-5.el9.0.2 baseos 32 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: openblas x86_64 0.3.29-1.el9 appstream 41 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: pciutils x86_64 3.7.0-7.el9 baseos 92 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: perl-Benchmark noarch 1.23-481.1.el9_6 appstream 25 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: protobuf x86_64 3.14.0-17.el9_7 appstream 1.0 M 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: protobuf-compiler x86_64 3.14.0-17.el9_7 crb 862 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: python3-babel noarch 2.9.1-2.el9 appstream 5.8 M 2026-03-07T01:31:40.513 INFO:teuthology.orchestra.run.vm07.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-ceph-argparse x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 45 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-ceph-common x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph 142 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 241 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-cryptography x86_64 36.0.1-5.el9_6 baseos 1.2 M 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-devel x86_64 3.9.23-2.el9 appstream 205 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-jinja2 noarch 2.11.3-8.el9_5 appstream 228 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 166 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-mako noarch 1.1.4-6.el9 appstream 144 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 32 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-numpy x86_64 1:1.23.5-1.el9 appstream 5.8 M 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-numpy-f2py x86_64 1:1.23.5-1.el9 appstream 368 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-packaging noarch 20.9-5.el9 appstream 69 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-ply noarch 3.11-14.el9.0.1 baseos 103 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-protobuf noarch 3.14.0-17.el9_7 appstream 237 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyasn1 noarch 0.4.8-7.el9_7 appstream 132 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9_7 appstream 210 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-pycparser noarch 2.20-6.el9 baseos 124 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyparsing noarch 2.4.7-9.el9.0.1 baseos 150 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-requests noarch 2.25.1-10.el9_6 baseos 115 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 43 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-toml noarch 0.10.2-6.el9.0.1 appstream 44 k 2026-03-07T01:31:40.514 INFO:teuthology.orchestra.run.vm07.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: python3-urllib3 noarch 1.26.5-6.el9_7.1 baseos 191 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: qatlib x86_64 24.09.0-1.el9 appstream 221 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 65 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: socat x86_64 1.7.4.1-8.el9 appstream 299 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: unzip x86_64 6.0-59.el9 baseos 180 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 188 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 89 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 63 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: zip x86_64 3.0-35.el9 baseos 263 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout:Installing weak dependencies: 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso ceph-noarch 22 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.0 M 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: qatlib-service x86_64 24.09.0-1.el9 appstream 36 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: smartmontools x86_64 1:7.2-9.el9 baseos 551 k 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout:============================================================================================== 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout:Install 152 Packages 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout:Upgrade 2 Packages 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout:Total download size: 213 M 2026-03-07T01:31:40.515 INFO:teuthology.orchestra.run.vm07.stdout:Downloading Packages: 2026-03-07T01:31:41.679 INFO:teuthology.orchestra.run.vm07.stdout:(1/154): ceph-19.2.3-39.g340d3c24fc6.el9.clyso. 60 kB/s | 6.5 kB 00:00 2026-03-07T01:31:41.937 INFO:teuthology.orchestra.run.vm07.stdout:(2/154): ceph-fuse-19.2.3-39.g340d3c24fc6.el9.c 4.5 MB/s | 1.1 MB 00:00 2026-03-07T01:31:41.979 INFO:teuthology.orchestra.run.vm07.stdout:(3/154): ceph-immutable-object-cache-19.2.3-39. 3.4 MB/s | 145 kB 00:00 2026-03-07T01:31:42.118 INFO:teuthology.orchestra.run.vm07.stdout:(4/154): ceph-base-19.2.3-39.g340d3c24fc6.el9.c 10 MB/s | 5.5 MB 00:00 2026-03-07T01:31:42.194 INFO:teuthology.orchestra.run.vm07.stdout:(5/154): ceph-mds-19.2.3-39.g340d3c24fc6.el9.cl 11 MB/s | 2.4 MB 00:00 2026-03-07T01:31:42.225 INFO:teuthology.orchestra.run.vm07.stdout:(6/154): ceph-mgr-19.2.3-39.g340d3c24fc6.el9.cl 10 MB/s | 1.1 MB 00:00 2026-03-07T01:31:42.447 INFO:teuthology.orchestra.run.vm07.stdout:(7/154): ceph-common-19.2.3-39.g340d3c24fc6.el9 25 MB/s | 22 MB 00:00 2026-03-07T01:31:42.556 INFO:teuthology.orchestra.run.vm07.stdout:(8/154): ceph-mon-19.2.3-39.g340d3c24fc6.el9.cl 13 MB/s | 4.7 MB 00:00 2026-03-07T01:31:42.593 INFO:teuthology.orchestra.run.vm07.stdout:(9/154): ceph-selinux-19.2.3-39.g340d3c24fc6.el 694 kB/s | 25 kB 00:00 2026-03-07T01:31:42.777 INFO:teuthology.orchestra.run.vm07.stdout:(10/154): ceph-osd-19.2.3-39.g340d3c24fc6.el9.c 31 MB/s | 17 MB 00:00 2026-03-07T01:31:42.811 INFO:teuthology.orchestra.run.vm07.stdout:(11/154): libcephfs-devel-19.2.3-39.g340d3c24fc 976 kB/s | 34 kB 00:00 2026-03-07T01:31:42.945 INFO:teuthology.orchestra.run.vm07.stdout:(12/154): ceph-radosgw-19.2.3-39.g340d3c24fc6.e 22 MB/s | 11 MB 00:00 2026-03-07T01:31:42.956 INFO:teuthology.orchestra.run.vm07.stdout:(13/154): libcephfs2-19.2.3-39.g340d3c24fc6.el9 6.8 MB/s | 998 kB 00:00 2026-03-07T01:31:42.998 INFO:teuthology.orchestra.run.vm07.stdout:(14/154): libcephsqlite-19.2.3-39.g340d3c24fc6. 3.1 MB/s | 163 kB 00:00 2026-03-07T01:31:43.015 INFO:teuthology.orchestra.run.vm07.stdout:(15/154): librados-devel-19.2.3-39.g340d3c24fc6 2.1 MB/s | 126 kB 00:00 2026-03-07T01:31:43.081 INFO:teuthology.orchestra.run.vm07.stdout:(16/154): libradosstriper1-19.2.3-39.g340d3c24f 6.0 MB/s | 504 kB 00:00 2026-03-07T01:31:43.131 INFO:teuthology.orchestra.run.vm07.stdout:(17/154): python3-ceph-argparse-19.2.3-39.g340d 901 kB/s | 45 kB 00:00 2026-03-07T01:31:43.177 INFO:teuthology.orchestra.run.vm07.stdout:(18/154): python3-ceph-common-19.2.3-39.g340d3c 3.0 MB/s | 142 kB 00:00 2026-03-07T01:31:43.229 INFO:teuthology.orchestra.run.vm07.stdout:(19/154): python3-cephfs-19.2.3-39.g340d3c24fc6 3.1 MB/s | 165 kB 00:00 2026-03-07T01:31:43.291 INFO:teuthology.orchestra.run.vm07.stdout:(20/154): librgw2-19.2.3-39.g340d3c24fc6.el9.cl 20 MB/s | 5.4 MB 00:00 2026-03-07T01:31:43.443 INFO:teuthology.orchestra.run.vm07.stdout:(21/154): python3-rados-19.2.3-39.g340d3c24fc6. 1.5 MB/s | 322 kB 00:00 2026-03-07T01:31:43.548 INFO:teuthology.orchestra.run.vm07.stdout:(22/154): python3-rbd-19.2.3-39.g340d3c24fc6.el 1.2 MB/s | 302 kB 00:00 2026-03-07T01:31:43.563 INFO:teuthology.orchestra.run.vm07.stdout:(23/154): python3-rgw-19.2.3-39.g340d3c24fc6.el 835 kB/s | 100 kB 00:00 2026-03-07T01:31:43.586 INFO:teuthology.orchestra.run.vm07.stdout:(24/154): rbd-fuse-19.2.3-39.g340d3c24fc6.el9.c 2.2 MB/s | 85 kB 00:00 2026-03-07T01:31:43.638 INFO:teuthology.orchestra.run.vm07.stdout:(25/154): rbd-nbd-19.2.3-39.g340d3c24fc6.el9.cl 3.2 MB/s | 170 kB 00:00 2026-03-07T01:31:43.671 INFO:teuthology.orchestra.run.vm07.stdout:(26/154): ceph-grafana-dashboards-19.2.3-39.g34 950 kB/s | 31 kB 00:00 2026-03-07T01:31:43.715 INFO:teuthology.orchestra.run.vm07.stdout:(27/154): ceph-mgr-cephadm-19.2.3-39.g340d3c24f 3.3 MB/s | 150 kB 00:00 2026-03-07T01:31:43.748 INFO:teuthology.orchestra.run.vm07.stdout:(28/154): rbd-mirror-19.2.3-39.g340d3c24fc6.el9 17 MB/s | 3.1 MB 00:00 2026-03-07T01:31:43.930 INFO:teuthology.orchestra.run.vm07.stdout:(29/154): ceph-test-19.2.3-39.g340d3c24fc6.el9. 37 MB/s | 50 MB 00:01 2026-03-07T01:31:43.966 INFO:teuthology.orchestra.run.vm07.stdout:(30/154): ceph-mgr-k8sevents-19.2.3-39.g340d3c2 628 kB/s | 22 kB 00:00 2026-03-07T01:31:44.011 INFO:teuthology.orchestra.run.vm07.stdout:(31/154): ceph-mgr-dashboard-19.2.3-39.g340d3c2 13 MB/s | 3.8 MB 00:00 2026-03-07T01:31:44.013 INFO:teuthology.orchestra.run.vm07.stdout:(32/154): ceph-mgr-modules-core-19.2.3-39.g340d 5.2 MB/s | 252 kB 00:00 2026-03-07T01:31:44.040 INFO:teuthology.orchestra.run.vm07.stdout:(33/154): ceph-mgr-diskprediction-local-19.2.3- 25 MB/s | 7.4 MB 00:00 2026-03-07T01:31:44.042 INFO:teuthology.orchestra.run.vm07.stdout:(34/154): ceph-prometheus-alerts-19.2.3-39.g340 580 kB/s | 16 kB 00:00 2026-03-07T01:31:44.043 INFO:teuthology.orchestra.run.vm07.stdout:(35/154): ceph-mgr-rook-19.2.3-39.g340d3c24fc6. 1.5 MB/s | 49 kB 00:00 2026-03-07T01:31:44.056 INFO:teuthology.orchestra.run.vm07.stdout:(36/154): abseil-cpp-20211102.0-4.el9.x86_64.rp 42 MB/s | 551 kB 00:00 2026-03-07T01:31:44.063 INFO:teuthology.orchestra.run.vm07.stdout:(37/154): gperftools-libs-2.9.1-3.el9.x86_64.rp 46 MB/s | 308 kB 00:00 2026-03-07T01:31:44.066 INFO:teuthology.orchestra.run.vm07.stdout:(38/154): grpc-data-1.46.7-10.el9.noarch.rpm 7.2 MB/s | 19 kB 00:00 2026-03-07T01:31:44.131 INFO:teuthology.orchestra.run.vm07.stdout:(39/154): libarrow-9.0.0-15.el9.x86_64.rpm 68 MB/s | 4.4 MB 00:00 2026-03-07T01:31:44.134 INFO:teuthology.orchestra.run.vm07.stdout:(40/154): libarrow-doc-9.0.0-15.el9.noarch.rpm 8.7 MB/s | 25 kB 00:00 2026-03-07T01:31:44.137 INFO:teuthology.orchestra.run.vm07.stdout:(41/154): liboath-2.6.12-1.el9.x86_64.rpm 17 MB/s | 49 kB 00:00 2026-03-07T01:31:44.140 INFO:teuthology.orchestra.run.vm07.stdout:(42/154): libunwind-1.6.2-1.el9.x86_64.rpm 21 MB/s | 67 kB 00:00 2026-03-07T01:31:44.145 INFO:teuthology.orchestra.run.vm07.stdout:(43/154): luarocks-3.9.2-5.el9.noarch.rpm 34 MB/s | 151 kB 00:00 2026-03-07T01:31:44.157 INFO:teuthology.orchestra.run.vm07.stdout:(44/154): parquet-libs-9.0.0-15.el9.x86_64.rpm 66 MB/s | 838 kB 00:00 2026-03-07T01:31:44.167 INFO:teuthology.orchestra.run.vm07.stdout:(45/154): python3-asyncssh-2.13.2-5.el9.noarch. 58 MB/s | 548 kB 00:00 2026-03-07T01:31:44.169 INFO:teuthology.orchestra.run.vm07.stdout:(46/154): python3-autocommand-2.2.2-8.el9.noarc 12 MB/s | 29 kB 00:00 2026-03-07T01:31:44.172 INFO:teuthology.orchestra.run.vm07.stdout:(47/154): python3-backports-tarfile-1.2.0-1.el9 20 MB/s | 60 kB 00:00 2026-03-07T01:31:44.175 INFO:teuthology.orchestra.run.vm07.stdout:(48/154): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 15 MB/s | 43 kB 00:00 2026-03-07T01:31:44.178 INFO:teuthology.orchestra.run.vm07.stdout:(49/154): python3-cachetools-4.2.4-1.el9.noarch 11 MB/s | 32 kB 00:00 2026-03-07T01:31:44.181 INFO:teuthology.orchestra.run.vm07.stdout:(50/154): python3-certifi-2023.05.07-4.el9.noar 5.7 MB/s | 14 kB 00:00 2026-03-07T01:31:44.185 INFO:teuthology.orchestra.run.vm07.stdout:(51/154): python3-cheroot-10.0.1-4.el9.noarch.r 36 MB/s | 173 kB 00:00 2026-03-07T01:31:44.193 INFO:teuthology.orchestra.run.vm07.stdout:(52/154): python3-cherrypy-18.6.1-2.el9.noarch. 50 MB/s | 358 kB 00:00 2026-03-07T01:31:44.196 INFO:teuthology.orchestra.run.vm07.stdout:(53/154): cephadm-19.2.3-39.g340d3c24fc6.el9.cl 4.9 MB/s | 769 kB 00:00 2026-03-07T01:31:44.198 INFO:teuthology.orchestra.run.vm07.stdout:(54/154): python3-google-auth-2.45.0-1.el9.noar 44 MB/s | 254 kB 00:00 2026-03-07T01:31:44.204 INFO:teuthology.orchestra.run.vm07.stdout:(55/154): python3-grpcio-tools-1.46.7-10.el9.x8 31 MB/s | 144 kB 00:00 2026-03-07T01:31:44.208 INFO:teuthology.orchestra.run.vm07.stdout:(56/154): python3-influxdb-5.3.1-1.el9.noarch.r 29 MB/s | 139 kB 00:00 2026-03-07T01:31:44.211 INFO:teuthology.orchestra.run.vm07.stdout:(57/154): python3-isodate-0.6.1-3.el9.noarch.rp 18 MB/s | 56 kB 00:00 2026-03-07T01:31:44.216 INFO:teuthology.orchestra.run.vm07.stdout:(58/154): python3-jaraco-8.2.1-3.el9.noarch.rpm 2.4 MB/s | 11 kB 00:00 2026-03-07T01:31:44.219 INFO:teuthology.orchestra.run.vm07.stdout:(59/154): ceph-volume-19.2.3-39.g340d3c24fc6.el 1.6 MB/s | 299 kB 00:00 2026-03-07T01:31:44.221 INFO:teuthology.orchestra.run.vm07.stdout:(60/154): python3-jaraco-classes-3.2.1-5.el9.no 3.8 MB/s | 18 kB 00:00 2026-03-07T01:31:44.225 INFO:teuthology.orchestra.run.vm07.stdout:(61/154): python3-jaraco-context-6.0.1-3.el9.no 4.3 MB/s | 20 kB 00:00 2026-03-07T01:31:44.233 INFO:teuthology.orchestra.run.vm07.stdout:(62/154): python3-grpcio-1.46.7-10.el9.x86_64.r 55 MB/s | 2.0 MB 00:00 2026-03-07T01:31:44.234 INFO:teuthology.orchestra.run.vm07.stdout:(63/154): python3-jaraco-collections-3.0.0-8.el 1.6 MB/s | 23 kB 00:00 2026-03-07T01:31:44.235 INFO:teuthology.orchestra.run.vm07.stdout:(64/154): python3-jaraco-functools-3.5.0-2.el9. 2.1 MB/s | 19 kB 00:00 2026-03-07T01:31:44.236 INFO:teuthology.orchestra.run.vm07.stdout:(65/154): python3-jaraco-text-4.0.0-2.el9.noarc 9.6 MB/s | 26 kB 00:00 2026-03-07T01:31:44.241 INFO:teuthology.orchestra.run.vm07.stdout:(66/154): python3-more-itertools-8.12.0-2.el9.n 16 MB/s | 79 kB 00:00 2026-03-07T01:31:44.242 INFO:teuthology.orchestra.run.vm07.stdout:(67/154): python3-logutils-0.3.5-21.el9.noarch. 6.1 MB/s | 46 kB 00:00 2026-03-07T01:31:44.245 INFO:teuthology.orchestra.run.vm07.stdout:(68/154): python3-msgpack-1.0.3-2.el9.x86_64.rp 20 MB/s | 86 kB 00:00 2026-03-07T01:31:44.250 INFO:teuthology.orchestra.run.vm07.stdout:(69/154): python3-kubernetes-26.1.0-3.el9.noarc 63 MB/s | 1.0 MB 00:00 2026-03-07T01:31:44.251 INFO:teuthology.orchestra.run.vm07.stdout:(70/154): python3-natsort-7.1.1-5.el9.noarch.rp 6.4 MB/s | 58 kB 00:00 2026-03-07T01:31:44.254 INFO:teuthology.orchestra.run.vm07.stdout:(71/154): python3-pecan-1.4.2-3.el9.noarch.rpm 31 MB/s | 272 kB 00:00 2026-03-07T01:31:44.255 INFO:teuthology.orchestra.run.vm07.stdout:(72/154): python3-portend-3.1.0-2.el9.noarch.rp 3.6 MB/s | 16 kB 00:00 2026-03-07T01:31:44.257 INFO:teuthology.orchestra.run.vm07.stdout:(73/154): python3-pyOpenSSL-21.0.0-1.el9.noarch 17 MB/s | 90 kB 00:00 2026-03-07T01:31:44.258 INFO:teuthology.orchestra.run.vm07.stdout:(74/154): python3-repoze-lru-0.7-16.el9.noarch. 9.0 MB/s | 31 kB 00:00 2026-03-07T01:31:44.260 INFO:teuthology.orchestra.run.vm07.stdout:(75/154): python3-routes-2.5.1-5.el9.noarch.rpm 38 MB/s | 188 kB 00:00 2026-03-07T01:31:44.262 INFO:teuthology.orchestra.run.vm07.stdout:(76/154): python3-saml-1.16.0-1.el9.noarch.rpm 30 MB/s | 125 kB 00:00 2026-03-07T01:31:44.263 INFO:teuthology.orchestra.run.vm07.stdout:(77/154): python3-rsa-4.9-2.el9.noarch.rpm 9.4 MB/s | 59 kB 00:00 2026-03-07T01:31:44.264 INFO:teuthology.orchestra.run.vm07.stdout:(78/154): python3-tempora-5.0.0-2.el9.noarch.rp 9.6 MB/s | 36 kB 00:00 2026-03-07T01:31:44.265 INFO:teuthology.orchestra.run.vm07.stdout:(79/154): python3-typing-extensions-4.15.0-1.el 25 MB/s | 86 kB 00:00 2026-03-07T01:31:44.269 INFO:teuthology.orchestra.run.vm07.stdout:(80/154): python3-webob-1.8.8-2.el9.noarch.rpm 39 MB/s | 230 kB 00:00 2026-03-07T01:31:44.273 INFO:teuthology.orchestra.run.vm07.stdout:(81/154): python3-werkzeug-2.0.3-3.el9.1.noarch 54 MB/s | 427 kB 00:00 2026-03-07T01:31:44.275 INFO:teuthology.orchestra.run.vm07.stdout:(82/154): python3-websocket-client-1.2.3-2.el9. 7.9 MB/s | 90 kB 00:00 2026-03-07T01:31:44.276 INFO:teuthology.orchestra.run.vm07.stdout:(83/154): python3-xmlsec-1.3.13-1.el9.x86_64.rp 6.8 MB/s | 48 kB 00:00 2026-03-07T01:31:44.277 INFO:teuthology.orchestra.run.vm07.stdout:(84/154): python3-xmltodict-0.12.0-15.el9.noarc 6.5 MB/s | 22 kB 00:00 2026-03-07T01:31:44.278 INFO:teuthology.orchestra.run.vm07.stdout:(85/154): python3-zc-lockfile-2.0-10.el9.noarch 7.1 MB/s | 20 kB 00:00 2026-03-07T01:31:44.282 INFO:teuthology.orchestra.run.vm07.stdout:(86/154): re2-20211101-20.el9.x86_64.rpm 35 MB/s | 191 kB 00:00 2026-03-07T01:31:44.288 INFO:teuthology.orchestra.run.vm07.stdout:(87/154): s3cmd-2.4.0-1.el9.noarch.rpm 18 MB/s | 206 kB 00:00 2026-03-07T01:31:44.313 INFO:teuthology.orchestra.run.vm07.stdout:(88/154): thrift-0.15.0-4.el9.x86_64.rpm 45 MB/s | 1.6 MB 00:00 2026-03-07T01:31:44.899 INFO:teuthology.orchestra.run.vm07.stdout:(89/154): bzip2-1.0.8-10.el9_5.x86_64.rpm 83 kB/s | 51 kB 00:00 2026-03-07T01:31:45.003 INFO:teuthology.orchestra.run.vm07.stdout:(90/154): c-ares-1.19.1-2.el9_4.x86_64.rpm 153 kB/s | 110 kB 00:00 2026-03-07T01:31:45.103 INFO:teuthology.orchestra.run.vm07.stdout:(91/154): fuse-2.9.9-17.el9.x86_64.rpm 380 kB/s | 78 kB 00:00 2026-03-07T01:31:45.106 INFO:teuthology.orchestra.run.vm07.stdout:(92/154): ledmon-libs-1.1.0-3.el9.x86_64.rpm 392 kB/s | 41 kB 00:00 2026-03-07T01:31:45.115 INFO:teuthology.orchestra.run.vm07.stdout:(93/154): cryptsetup-2.7.2-4.el9.x86_64.rpm 386 kB/s | 310 kB 00:00 2026-03-07T01:31:45.207 INFO:teuthology.orchestra.run.vm07.stdout:(94/154): libconfig-1.7.2-9.el9.x86_64.rpm 681 kB/s | 71 kB 00:00 2026-03-07T01:31:45.414 INFO:teuthology.orchestra.run.vm07.stdout:(95/154): libgfortran-11.5.0-11.el9.x86_64.rpm 2.5 MB/s | 794 kB 00:00 2026-03-07T01:31:45.415 INFO:teuthology.orchestra.run.vm07.stdout:(96/154): libquadmath-11.5.0-11.el9.x86_64.rpm 614 kB/s | 184 kB 00:00 2026-03-07T01:31:45.416 INFO:teuthology.orchestra.run.vm07.stdout:(97/154): lmdb-libs-0.9.29-3.el9.x86_64.rpm 286 kB/s | 60 kB 00:00 2026-03-07T01:31:45.521 INFO:teuthology.orchestra.run.vm07.stdout:(98/154): mailcap-2.1.49-5.el9.0.2.noarch.rpm 303 kB/s | 32 kB 00:00 2026-03-07T01:31:45.522 INFO:teuthology.orchestra.run.vm07.stdout:(99/154): pciutils-3.7.0-7.el9.x86_64.rpm 872 kB/s | 92 kB 00:00 2026-03-07T01:31:45.532 INFO:teuthology.orchestra.run.vm07.stdout:(100/154): nvme-cli-2.13-1.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2026-03-07T01:31:45.627 INFO:teuthology.orchestra.run.vm07.stdout:(101/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.2 MB/s | 241 kB 00:00 2026-03-07T01:31:45.639 INFO:teuthology.orchestra.run.vm07.stdout:(102/154): python3-cryptography-36.0.1-5.el9_6. 10 MB/s | 1.2 MB 00:00 2026-03-07T01:31:45.640 INFO:teuthology.orchestra.run.vm07.stdout:(103/154): python3-ply-3.11-14.el9.0.1.noarch.r 946 kB/s | 103 kB 00:00 2026-03-07T01:31:45.733 INFO:teuthology.orchestra.run.vm07.stdout:(104/154): python3-pycparser-2.20-6.el9.noarch. 1.1 MB/s | 124 kB 00:00 2026-03-07T01:31:45.745 INFO:teuthology.orchestra.run.vm07.stdout:(105/154): python3-pyparsing-2.4.7-9.el9.0.1.no 1.4 MB/s | 150 kB 00:00 2026-03-07T01:31:45.746 INFO:teuthology.orchestra.run.vm07.stdout:(106/154): python3-requests-2.25.1-10.el9_6.noa 1.1 MB/s | 115 kB 00:00 2026-03-07T01:31:45.839 INFO:teuthology.orchestra.run.vm07.stdout:(107/154): python3-urllib3-1.26.5-6.el9_7.1.noa 1.8 MB/s | 191 kB 00:00 2026-03-07T01:31:45.855 INFO:teuthology.orchestra.run.vm07.stdout:(108/154): smartmontools-7.2-9.el9.x86_64.rpm 4.9 MB/s | 551 kB 00:00 2026-03-07T01:31:45.856 INFO:teuthology.orchestra.run.vm07.stdout:(109/154): unzip-6.0-59.el9.x86_64.rpm 1.6 MB/s | 180 kB 00:00 2026-03-07T01:31:45.946 INFO:teuthology.orchestra.run.vm07.stdout:(110/154): zip-3.0-35.el9.x86_64.rpm 2.4 MB/s | 263 kB 00:00 2026-03-07T01:31:46.209 INFO:teuthology.orchestra.run.vm07.stdout:(111/154): flexiblas-3.0.4-8.el9.0.1.x86_64.rpm 84 kB/s | 30 kB 00:00 2026-03-07T01:31:46.383 INFO:teuthology.orchestra.run.vm07.stdout:(112/154): flexiblas-openblas-openmp-3.0.4-8.el 86 kB/s | 15 kB 00:00 2026-03-07T01:31:46.420 INFO:teuthology.orchestra.run.vm07.stdout:(113/154): boost-program-options-1.75.0-13.el9_ 185 kB/s | 104 kB 00:00 2026-03-07T01:31:46.673 INFO:teuthology.orchestra.run.vm07.stdout:(114/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 629 kB/s | 159 kB 00:00 2026-03-07T01:31:46.783 INFO:teuthology.orchestra.run.vm07.stdout:(115/154): libnbd-1.20.3-4.el9.x86_64.rpm 428 kB/s | 171 kB 00:00 2026-03-07T01:31:46.806 INFO:teuthology.orchestra.run.vm07.stdout:(116/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 334 kB/s | 44 kB 00:00 2026-03-07T01:31:46.999 INFO:teuthology.orchestra.run.vm07.stdout:(117/154): libstoragemgmt-1.10.1-1.el9.x86_64.r 1.2 MB/s | 243 kB 00:00 2026-03-07T01:31:47.057 INFO:teuthology.orchestra.run.vm07.stdout:(118/154): flexiblas-netlib-3.0.4-8.el9.0.1.x86 2.7 MB/s | 3.0 MB 00:01 2026-03-07T01:31:47.149 INFO:teuthology.orchestra.run.vm07.stdout:(119/154): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2026-03-07T01:31:47.178 INFO:teuthology.orchestra.run.vm07.stdout:(120/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 282 kB 00:00 2026-03-07T01:31:47.184 INFO:teuthology.orchestra.run.vm07.stdout:(121/154): libxslt-1.1.34-13.el9_6.x86_64.rpm 1.3 MB/s | 239 kB 00:00 2026-03-07T01:31:47.293 INFO:teuthology.orchestra.run.vm07.stdout:(122/154): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2026-03-07T01:31:47.294 INFO:teuthology.orchestra.run.vm07.stdout:(123/154): openblas-0.3.29-1.el9.x86_64.rpm 356 kB/s | 41 kB 00:00 2026-03-07T01:31:47.406 INFO:teuthology.orchestra.run.vm07.stdout:(124/154): perl-Test-Harness-3.42-461.el9.noarc 2.3 MB/s | 267 kB 00:00 2026-03-07T01:31:47.423 INFO:teuthology.orchestra.run.vm07.stdout:(125/154): perl-Benchmark-1.23-481.1.el9_6.noar 196 kB/s | 25 kB 00:00 2026-03-07T01:31:47.557 INFO:teuthology.orchestra.run.vm07.stdout:(126/154): protobuf-3.14.0-17.el9_7.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2026-03-07T01:31:47.684 INFO:teuthology.orchestra.run.vm07.stdout:(127/154): python3-devel-3.9.23-2.el9.x86_64.rp 1.6 MB/s | 205 kB 00:00 2026-03-07T01:31:47.786 INFO:teuthology.orchestra.run.vm07.stdout:(128/154): openblas-openmp-0.3.29-1.el9.x86_64. 8.8 MB/s | 5.3 MB 00:00 2026-03-07T01:31:47.802 INFO:teuthology.orchestra.run.vm07.stdout:(129/154): python3-jinja2-2.11.3-8.el9_5.noarch 1.9 MB/s | 228 kB 00:00 2026-03-07T01:31:47.907 INFO:teuthology.orchestra.run.vm07.stdout:(130/154): python3-libstoragemgmt-1.10.1-1.el9. 1.4 MB/s | 166 kB 00:00 2026-03-07T01:31:47.960 INFO:teuthology.orchestra.run.vm07.stdout:(131/154): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 5.8 MB 00:00 2026-03-07T01:31:47.964 INFO:teuthology.orchestra.run.vm07.stdout:(132/154): python3-lxml-4.6.5-3.el9.x86_64.rpm 7.4 MB/s | 1.2 MB 00:00 2026-03-07T01:31:48.030 INFO:teuthology.orchestra.run.vm07.stdout:(133/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 144 kB 00:00 2026-03-07T01:31:48.082 INFO:teuthology.orchestra.run.vm07.stdout:(134/154): python3-markupsafe-1.1.1-12.el9.x86_ 261 kB/s | 32 kB 00:00 2026-03-07T01:31:48.158 INFO:teuthology.orchestra.run.vm07.stdout:(135/154): python3-numpy-f2py-1.23.5-1.el9.x86_ 2.8 MB/s | 368 kB 00:00 2026-03-07T01:31:48.208 INFO:teuthology.orchestra.run.vm07.stdout:(136/154): python3-packaging-20.9-5.el9.noarch. 544 kB/s | 69 kB 00:00 2026-03-07T01:31:48.281 INFO:teuthology.orchestra.run.vm07.stdout:(137/154): python3-protobuf-3.14.0-17.el9_7.noa 1.9 MB/s | 237 kB 00:00 2026-03-07T01:31:48.329 INFO:teuthology.orchestra.run.vm07.stdout:(138/154): python3-pyasn1-0.4.8-7.el9_7.noarch. 1.1 MB/s | 132 kB 00:00 2026-03-07T01:31:48.384 INFO:teuthology.orchestra.run.vm07.stdout:(139/154): python3-numpy-1.23.5-1.el9.x86_64.rp 14 MB/s | 5.8 MB 00:00 2026-03-07T01:31:48.408 INFO:teuthology.orchestra.run.vm07.stdout:(140/154): python3-pyasn1-modules-0.4.8-7.el9_7 1.6 MB/s | 210 kB 00:00 2026-03-07T01:31:48.453 INFO:teuthology.orchestra.run.vm07.stdout:(141/154): python3-requests-oauthlib-1.3.0-12.e 348 kB/s | 43 kB 00:00 2026-03-07T01:31:48.526 INFO:teuthology.orchestra.run.vm07.stdout:(142/154): python3-toml-0.10.2-6.el9.0.1.noarch 378 kB/s | 44 kB 00:00 2026-03-07T01:31:48.573 INFO:teuthology.orchestra.run.vm07.stdout:(143/154): qatlib-24.09.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2026-03-07T01:31:48.643 INFO:teuthology.orchestra.run.vm07.stdout:(144/154): qatlib-service-24.09.0-1.el9.x86_64. 309 kB/s | 36 kB 00:00 2026-03-07T01:31:48.703 INFO:teuthology.orchestra.run.vm07.stdout:(145/154): qatzip-libs-1.3.1-1.el9.x86_64.rpm 504 kB/s | 65 kB 00:00 2026-03-07T01:31:48.821 INFO:teuthology.orchestra.run.vm07.stdout:(146/154): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2026-03-07T01:31:48.878 INFO:teuthology.orchestra.run.vm07.stdout:(147/154): socat-1.7.4.1-8.el9.x86_64.rpm 1.2 MB/s | 299 kB 00:00 2026-03-07T01:31:48.950 INFO:teuthology.orchestra.run.vm07.stdout:(148/154): xmlsec1-openssl-1.2.29-13.el9.x86_64 695 kB/s | 89 kB 00:00 2026-03-07T01:31:48.997 INFO:teuthology.orchestra.run.vm07.stdout:(149/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 529 kB/s | 63 kB 00:00 2026-03-07T01:31:49.406 INFO:teuthology.orchestra.run.vm07.stdout:(150/154): lua-devel-5.4.4-4.el9.x86_64.rpm 47 kB/s | 21 kB 00:00 2026-03-07T01:31:50.047 INFO:teuthology.orchestra.run.vm07.stdout:(151/154): python3-scipy-1.9.3-2.el9.x86_64.rpm 11 MB/s | 19 MB 00:01 2026-03-07T01:31:50.065 INFO:teuthology.orchestra.run.vm07.stdout:(152/154): protobuf-compiler-3.14.0-17.el9_7.x8 807 kB/s | 862 kB 00:01 2026-03-07T01:31:50.331 INFO:teuthology.orchestra.run.vm07.stdout:(153/154): librados2-19.2.3-39.g340d3c24fc6.el9 3.7 MB/s | 3.4 MB 00:00 2026-03-07T01:31:50.515 INFO:teuthology.orchestra.run.vm07.stdout:(154/154): librbd1-19.2.3-39.g340d3c24fc6.el9.c 6.8 MB/s | 3.2 MB 00:00 2026-03-07T01:31:50.522 INFO:teuthology.orchestra.run.vm07.stdout:-------------------------------------------------------------------------------- 2026-03-07T01:31:50.522 INFO:teuthology.orchestra.run.vm07.stdout:Total 21 MB/s | 213 MB 00:10 2026-03-07T01:31:51.276 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:31:51.330 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:31:51.330 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:31:52.202 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:31:52.203 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:31:53.171 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:31:53.185 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/156 2026-03-07T01:31:53.194 INFO:teuthology.orchestra.run.vm07.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/156 2026-03-07T01:31:53.206 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libxslt-1.1.34-13.el9_6.x86_64 3/156 2026-03-07T01:31:53.211 INFO:teuthology.orchestra.run.vm07.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/156 2026-03-07T01:31:53.214 INFO:teuthology.orchestra.run.vm07.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/156 2026-03-07T01:31:53.229 INFO:teuthology.orchestra.run.vm07.stdout: Installing : lmdb-libs-0.9.29-3.el9.x86_64 6/156 2026-03-07T01:31:53.411 INFO:teuthology.orchestra.run.vm07.stdout: Installing : thrift-0.15.0-4.el9.x86_64 7/156 2026-03-07T01:31:53.421 INFO:teuthology.orchestra.run.vm07.stdout: Upgrading : librados2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 8/156 2026-03-07T01:31:53.485 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: librados2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 8/156 2026-03-07T01:31:53.487 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libcephfs2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 9/156 2026-03-07T01:31:53.522 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libcephfs2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 9/156 2026-03-07T01:31:53.529 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-rados-2:19.2.3-39.g340d3c24fc6.el9.clyso 10/156 2026-03-07T01:31:53.539 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 11/156 2026-03-07T01:31:53.549 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 12/156 2026-03-07T01:31:53.551 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libcephsqlite-2:19.2.3-39.g340d3c24fc6.el9.clyso 13/156 2026-03-07T01:31:53.590 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libcephsqlite-2:19.2.3-39.g340d3c24fc6.el9.clyso 13/156 2026-03-07T01:31:53.594 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libradosstriper1-2:19.2.3-39.g340d3c24fc6.el9.cl 14/156 2026-03-07T01:31:53.655 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libradosstriper1-2:19.2.3-39.g340d3c24fc6.el9.cl 14/156 2026-03-07T01:31:53.664 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 15/156 2026-03-07T01:31:53.693 INFO:teuthology.orchestra.run.vm07.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 16/156 2026-03-07T01:31:53.701 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-pyasn1-0.4.8-7.el9_7.noarch 17/156 2026-03-07T01:31:53.712 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/156 2026-03-07T01:31:53.719 INFO:teuthology.orchestra.run.vm07.stdout: Installing : protobuf-3.14.0-17.el9_7.x86_64 19/156 2026-03-07T01:31:53.723 INFO:teuthology.orchestra.run.vm07.stdout: Installing : lua-5.4.4-4.el9.x86_64 20/156 2026-03-07T01:31:53.729 INFO:teuthology.orchestra.run.vm07.stdout: Installing : flexiblas-3.0.4-8.el9.0.1.x86_64 21/156 2026-03-07T01:31:53.760 INFO:teuthology.orchestra.run.vm07.stdout: Installing : unzip-6.0-59.el9.x86_64 22/156 2026-03-07T01:31:53.786 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-urllib3-1.26.5-6.el9_7.1.noarch 23/156 2026-03-07T01:31:53.791 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-requests-2.25.1-10.el9_6.noarch 24/156 2026-03-07T01:31:53.798 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libquadmath-11.5.0-11.el9.x86_64 25/156 2026-03-07T01:31:53.801 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libgfortran-11.5.0-11.el9.x86_64 26/156 2026-03-07T01:31:53.805 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 27/156 2026-03-07T01:31:53.849 INFO:teuthology.orchestra.run.vm07.stdout: Installing : re2-1:20211101-20.el9.x86_64 28/156 2026-03-07T01:31:53.888 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 29/156 2026-03-07T01:31:53.893 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 30/156 2026-03-07T01:31:53.925 INFO:teuthology.orchestra.run.vm07.stdout: Installing : liboath-2.6.12-1.el9.x86_64 31/156 2026-03-07T01:31:53.940 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-ceph-common-2:19.2.3-39.g340d3c24fc6.el9 32/156 2026-03-07T01:31:53.951 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-ceph-argparse-2:19.2.3-39.g340d3c24fc6.e 33/156 2026-03-07T01:31:53.966 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-cephfs-2:19.2.3-39.g340d3c24fc6.el9.clys 34/156 2026-03-07T01:31:53.975 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 35/156 2026-03-07T01:31:54.007 INFO:teuthology.orchestra.run.vm07.stdout: Installing : zip-3.0-35.el9.x86_64 36/156 2026-03-07T01:31:54.015 INFO:teuthology.orchestra.run.vm07.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/156 2026-03-07T01:31:54.024 INFO:teuthology.orchestra.run.vm07.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/156 2026-03-07T01:31:54.057 INFO:teuthology.orchestra.run.vm07.stdout: Installing : protobuf-compiler-3.14.0-17.el9_7.x86_64 39/156 2026-03-07T01:31:54.090 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/156 2026-03-07T01:31:54.157 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/156 2026-03-07T01:31:54.174 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9_7.noarch 42/156 2026-03-07T01:31:54.180 INFO:teuthology.orchestra.run.vm07.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 43/156 2026-03-07T01:31:54.187 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 44/156 2026-03-07T01:31:54.197 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/156 2026-03-07T01:31:54.203 INFO:teuthology.orchestra.run.vm07.stdout: Installing : librados-devel-2:19.2.3-39.g340d3c24fc6.el9.clys 46/156 2026-03-07T01:31:54.214 INFO:teuthology.orchestra.run.vm07.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 47/156 2026-03-07T01:31:54.223 INFO:teuthology.orchestra.run.vm07.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 48/156 2026-03-07T01:31:54.228 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-toml-0.10.2-6.el9.0.1.noarch 49/156 2026-03-07T01:31:54.237 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 50/156 2026-03-07T01:31:54.242 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 51/156 2026-03-07T01:31:54.280 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 52/156 2026-03-07T01:31:54.326 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-protobuf-3.14.0-17.el9_7.noarch 53/156 2026-03-07T01:31:54.618 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-devel-3.9.23-2.el9.x86_64 54/156 2026-03-07T01:31:54.750 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 55/156 2026-03-07T01:31:54.755 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-jinja2-2.11.3-8.el9_5.noarch 56/156 2026-03-07T01:31:54.759 INFO:teuthology.orchestra.run.vm07.stdout: Installing : perl-Benchmark-1.23-481.1.el9_6.noarch 57/156 2026-03-07T01:31:54.829 INFO:teuthology.orchestra.run.vm07.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/156 2026-03-07T01:31:54.833 INFO:teuthology.orchestra.run.vm07.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/156 2026-03-07T01:31:54.862 INFO:teuthology.orchestra.run.vm07.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.0.1.x86_64 60/156 2026-03-07T01:31:55.287 INFO:teuthology.orchestra.run.vm07.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.0.1.x86_64 61/156 2026-03-07T01:31:55.389 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-numpy-1:1.23.5-1.el9.x86_64 62/156 2026-03-07T01:31:56.275 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-numpy-f2py-1:1.23.5-1.el9.x86_64 63/156 2026-03-07T01:31:56.298 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/156 2026-03-07T01:31:56.469 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 65/156 2026-03-07T01:31:56.472 INFO:teuthology.orchestra.run.vm07.stdout: Upgrading : librbd1-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_6 66/156 2026-03-07T01:31:56.506 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: librbd1-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_6 66/156 2026-03-07T01:31:56.510 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-rbd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 67/156 2026-03-07T01:31:56.533 INFO:teuthology.orchestra.run.vm07.stdout: Installing : boost-program-options-1.75.0-13.el9_7.x86_64 68/156 2026-03-07T01:31:56.536 INFO:teuthology.orchestra.run.vm07.stdout: Installing : smartmontools-1:7.2-9.el9.x86_64 69/156 2026-03-07T01:31:56.556 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: smartmontools-1:7.2-9.el9.x86_64 69/156 2026-03-07T01:31:56.556 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/smartd.service → /usr/lib/systemd/system/smartd.service. 2026-03-07T01:31:56.556 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:31:56.584 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-pyparsing-2.4.7-9.el9.0.1.noarch 70/156 2026-03-07T01:31:56.595 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/156 2026-03-07T01:31:56.612 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-ply-3.11-14.el9.0.1.noarch 72/156 2026-03-07T01:31:56.634 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/156 2026-03-07T01:31:56.730 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/156 2026-03-07T01:31:56.744 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-cryptography-36.0.1-5.el9_6.x86_64 75/156 2026-03-07T01:31:56.775 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/156 2026-03-07T01:31:56.785 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/156 2026-03-07T01:31:56.793 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 78/156 2026-03-07T01:31:56.796 INFO:teuthology.orchestra.run.vm07.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 79/156 2026-03-07T01:31:56.827 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: qatlib-24.09.0-1.el9.x86_64 80/156 2026-03-07T01:31:56.832 INFO:teuthology.orchestra.run.vm07.stdout: Installing : qatlib-24.09.0-1.el9.x86_64 80/156 2026-03-07T01:31:56.834 INFO:teuthology.orchestra.run.vm07.stdout: Installing : qatlib-service-24.09.0-1.el9.x86_64 81/156 2026-03-07T01:31:56.857 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: qatlib-service-24.09.0-1.el9.x86_64 81/156 2026-03-07T01:31:57.009 INFO:teuthology.orchestra.run.vm07.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 82/156 2026-03-07T01:31:57.015 INFO:teuthology.orchestra.run.vm07.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 83/156 2026-03-07T01:31:57.442 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 83/156 2026-03-07T01:31:57.442 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-03-07T01:31:57.442 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:31:57.449 INFO:teuthology.orchestra.run.vm07.stdout: Installing : mailcap-2.1.49-5.el9.0.2.noarch 84/156 2026-03-07T01:31:57.454 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 85/156 2026-03-07T01:31:57.492 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 86/156 2026-03-07T01:31:57.492 INFO:teuthology.orchestra.run.vm07.stdout:Creating group 'libstoragemgmt' with GID 992. 2026-03-07T01:31:57.492 INFO:teuthology.orchestra.run.vm07.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 992 and GID 992. 2026-03-07T01:31:57.492 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:31:57.516 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 86/156 2026-03-07T01:31:57.577 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 86/156 2026-03-07T01:31:57.577 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-03-07T01:31:57.577 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:31:57.640 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 87/156 2026-03-07T01:31:57.686 INFO:teuthology.orchestra.run.vm07.stdout: Installing : fuse-2.9.9-17.el9.x86_64 88/156 2026-03-07T01:31:57.693 INFO:teuthology.orchestra.run.vm07.stdout: Installing : cryptsetup-2.7.2-4.el9.x86_64 89/156 2026-03-07T01:31:57.700 INFO:teuthology.orchestra.run.vm07.stdout: Installing : c-ares-1.19.1-2.el9_4.x86_64 90/156 2026-03-07T01:31:57.707 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 91/156 2026-03-07T01:31:57.736 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 92/156 2026-03-07T01:31:57.768 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 93/156 2026-03-07T01:31:57.778 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 94/156 2026-03-07T01:31:57.851 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 95/156 2026-03-07T01:31:57.865 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 96/156 2026-03-07T01:31:57.881 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 97/156 2026-03-07T01:31:57.896 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 98/156 2026-03-07T01:31:57.907 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 99/156 2026-03-07T01:31:57.936 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 100/156 2026-03-07T01:31:57.954 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 101/156 2026-03-07T01:31:58.030 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 102/156 2026-03-07T01:31:58.051 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 103/156 2026-03-07T01:31:58.075 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 104/156 2026-03-07T01:31:58.086 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 105/156 2026-03-07T01:31:58.098 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 106/156 2026-03-07T01:31:58.155 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 107/156 2026-03-07T01:31:58.597 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 108/156 2026-03-07T01:31:58.616 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 109/156 2026-03-07T01:31:58.625 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 110/156 2026-03-07T01:31:58.636 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 111/156 2026-03-07T01:31:58.646 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 112/156 2026-03-07T01:31:58.653 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 113/156 2026-03-07T01:31:58.695 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 114/156 2026-03-07T01:31:58.703 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 115/156 2026-03-07T01:31:58.712 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 116/156 2026-03-07T01:31:58.716 INFO:teuthology.orchestra.run.vm07.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 117/156 2026-03-07T01:31:58.724 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 118/156 2026-03-07T01:31:59.033 INFO:teuthology.orchestra.run.vm07.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 119/156 2026-03-07T01:31:59.104 INFO:teuthology.orchestra.run.vm07.stdout: Installing : librgw2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_6 120/156 2026-03-07T01:31:59.125 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: librgw2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_6 120/156 2026-03-07T01:31:59.127 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-rgw-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 121/156 2026-03-07T01:32:00.429 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-common-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 122/156 2026-03-07T01:32:00.435 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-common-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 122/156 2026-03-07T01:32:00.809 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-common-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 122/156 2026-03-07T01:32:00.816 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-base-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 123/156 2026-03-07T01:32:00.873 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-base-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 123/156 2026-03-07T01:32:00.873 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-03-07T01:32:00.873 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-03-07T01:32:00.873 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:00.884 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-selinux-2:19.2.3-39.g340d3c24fc6.el9.clyso. 124/156 2026-03-07T01:32:08.659 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-selinux-2:19.2.3-39.g340d3c24fc6.el9.clyso. 124/156 2026-03-07T01:32:08.659 INFO:teuthology.orchestra.run.vm07.stdout:skipping the directory /sys 2026-03-07T01:32:08.659 INFO:teuthology.orchestra.run.vm07.stdout:skipping the directory /proc 2026-03-07T01:32:08.659 INFO:teuthology.orchestra.run.vm07.stdout:skipping the directory /mnt 2026-03-07T01:32:08.659 INFO:teuthology.orchestra.run.vm07.stdout:skipping the directory /var/tmp 2026-03-07T01:32:08.659 INFO:teuthology.orchestra.run.vm07.stdout:skipping the directory /home 2026-03-07T01:32:08.659 INFO:teuthology.orchestra.run.vm07.stdout:skipping the directory /root 2026-03-07T01:32:08.659 INFO:teuthology.orchestra.run.vm07.stdout:skipping the directory /tmp 2026-03-07T01:32:08.659 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:08.751 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-volume-2:19.2.3-39.g340d3c24fc6.el9.clyso.n 125/156 2026-03-07T01:32:08.773 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-volume-2:19.2.3-39.g340d3c24fc6.el9.clyso.n 125/156 2026-03-07T01:32:08.773 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:32:08.773 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-03-07T01:32:08.773 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:09.626 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-osd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 126/156 2026-03-07T01:32:09.661 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-osd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 126/156 2026-03-07T01:32:09.661 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:32:09.661 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-03-07T01:32:09.661 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-03-07T01:32:09.661 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-03-07T01:32:09.661 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:09.797 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-mds-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 127/156 2026-03-07T01:32:09.824 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mds-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 127/156 2026-03-07T01:32:09.824 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:32:09.824 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-03-07T01:32:09.824 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-03-07T01:32:09.824 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-03-07T01:32:09.824 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:10.083 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-mon-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 128/156 2026-03-07T01:32:10.112 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mon-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 128/156 2026-03-07T01:32:10.112 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:32:10.112 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-03-07T01:32:10.112 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-03-07T01:32:10.112 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-03-07T01:32:10.112 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:10.149 INFO:teuthology.orchestra.run.vm07.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 129/156 2026-03-07T01:32:10.209 INFO:teuthology.orchestra.run.vm07.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 130/156 2026-03-07T01:32:10.228 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 131/156 2026-03-07T01:32:10.233 INFO:teuthology.orchestra.run.vm07.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 132/156 2026-03-07T01:32:10.303 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: cephadm-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarc 133/156 2026-03-07T01:32:10.309 INFO:teuthology.orchestra.run.vm07.stdout: Installing : cephadm-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarc 133/156 2026-03-07T01:32:10.316 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-39.g340d3c24fc6. 134/156 2026-03-07T01:32:10.341 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-39.g340d3c24fc6 135/156 2026-03-07T01:32:10.345 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-39.g340d3c24fc6.el9.cl 136/156 2026-03-07T01:32:10.927 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-39.g340d3c24fc6.el9.cl 136/156 2026-03-07T01:32:10.933 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-39.g340d3c24fc6.el9. 137/156 2026-03-07T01:32:11.539 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-39.g340d3c24fc6.el9. 137/156 2026-03-07T01:32:11.542 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-39.g340d3 138/156 2026-03-07T01:32:11.557 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-39.g340d3 138/156 2026-03-07T01:32:11.558 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-39.g340d3c24fc6.el9. 139/156 2026-03-07T01:32:11.621 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-39.g340d3c24fc6.el9. 139/156 2026-03-07T01:32:11.685 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-39.g340d3c24fc6.e 140/156 2026-03-07T01:32:11.688 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-mgr-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 141/156 2026-03-07T01:32:11.714 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mgr-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 141/156 2026-03-07T01:32:11.715 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:32:11.715 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-03-07T01:32:11.715 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-03-07T01:32:11.715 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-03-07T01:32:11.715 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:11.730 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-mgr-rook-2:19.2.3-39.g340d3c24fc6.el9.clyso 142/156 2026-03-07T01:32:11.750 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-39.g340d3c24fc6.el9.clyso 142/156 2026-03-07T01:32:12.315 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 143/156 2026-03-07T01:32:12.320 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-radosgw-2:19.2.3-39.g340d3c24fc6.el9.clyso. 144/156 2026-03-07T01:32:12.349 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-39.g340d3c24fc6.el9.clyso. 144/156 2026-03-07T01:32:12.349 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:32:12.349 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-03-07T01:32:12.349 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-03-07T01:32:12.349 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-03-07T01:32:12.349 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:12.360 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-39.g340d3c2 145/156 2026-03-07T01:32:12.386 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-39.g340d3c2 145/156 2026-03-07T01:32:12.386 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:32:12.386 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-03-07T01:32:12.386 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:12.554 INFO:teuthology.orchestra.run.vm07.stdout: Installing : rbd-mirror-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 146/156 2026-03-07T01:32:12.577 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: rbd-mirror-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 146/156 2026-03-07T01:32:12.577 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:32:12.577 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-03-07T01:32:12.577 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-03-07T01:32:12.577 INFO:teuthology.orchestra.run.vm07.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-03-07T01:32:12.577 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:15.290 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-test-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 147/156 2026-03-07T01:32:15.299 INFO:teuthology.orchestra.run.vm07.stdout: Installing : ceph-fuse-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 148/156 2026-03-07T01:32:15.313 INFO:teuthology.orchestra.run.vm07.stdout: Installing : rbd-fuse-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 149/156 2026-03-07T01:32:15.349 INFO:teuthology.orchestra.run.vm07.stdout: Installing : rbd-nbd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_6 150/156 2026-03-07T01:32:15.357 INFO:teuthology.orchestra.run.vm07.stdout: Installing : perl-Test-Harness-1:3.42-461.el9.noarch 151/156 2026-03-07T01:32:15.363 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libcephfs-devel-2:19.2.3-39.g340d3c24fc6.el9.cly 152/156 2026-03-07T01:32:15.383 INFO:teuthology.orchestra.run.vm07.stdout: Installing : bzip2-1.0.8-10.el9_5.x86_64 153/156 2026-03-07T01:32:15.387 INFO:teuthology.orchestra.run.vm07.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 154/156 2026-03-07T01:32:15.387 INFO:teuthology.orchestra.run.vm07.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 155/156 2026-03-07T01:32:15.406 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 155/156 2026-03-07T01:32:15.406 INFO:teuthology.orchestra.run.vm07.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 156/156 2026-03-07T01:32:17.169 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 156/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 1/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-base-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 2/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-common-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 3/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-fuse-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 4/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-39.g340d3c2 5/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mds-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 6/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mgr-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 7/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mon-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 8/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-osd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 9/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-radosgw-2:19.2.3-39.g340d3c24fc6.el9.clyso. 10/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-selinux-2:19.2.3-39.g340d3c24fc6.el9.clyso. 11/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-test-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 12/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libcephfs-devel-2:19.2.3-39.g340d3c24fc6.el9.cly 13/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libcephfs2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 14/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libcephsqlite-2:19.2.3-39.g340d3c24fc6.el9.clyso 15/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : librados-devel-2:19.2.3-39.g340d3c24fc6.el9.clys 16/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libradosstriper1-2:19.2.3-39.g340d3c24fc6.el9.cl 17/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : librgw2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_6 18/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-ceph-argparse-2:19.2.3-39.g340d3c24fc6.e 19/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-ceph-common-2:19.2.3-39.g340d3c24fc6.el9 20/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-cephfs-2:19.2.3-39.g340d3c24fc6.el9.clys 21/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-rados-2:19.2.3-39.g340d3c24fc6.el9.clyso 22/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-rbd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 23/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-rgw-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 24/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : rbd-fuse-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 25/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : rbd-mirror-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 26/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : rbd-nbd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_6 27/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-39.g340d3c24fc6 28/156 2026-03-07T01:32:17.170 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-39.g340d3c24fc6.el9.cl 29/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-39.g340d3c24fc6.el9. 30/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-39.g340d3 31/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-39.g340d3c24fc6.el9. 32/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-39.g340d3c24fc6.e 33/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mgr-rook-2:19.2.3-39.g340d3c24fc6.el9.clyso 34/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-39.g340d3c24fc6. 35/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-volume-2:19.2.3-39.g340d3c24fc6.el9.clyso.n 36/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : cephadm-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarc 37/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 38/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 39/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 40/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 41/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 42/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 43/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 44/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 45/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 46/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 47/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 48/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 49/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 50/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 51/156 2026-03-07T01:32:17.171 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 52/156 2026-03-07T01:32:17.172 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 53/156 2026-03-07T01:32:17.172 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 54/156 2026-03-07T01:32:17.172 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 55/156 2026-03-07T01:32:17.172 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 56/156 2026-03-07T01:32:17.172 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 57/156 2026-03-07T01:32:17.173 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 58/156 2026-03-07T01:32:17.173 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 59/156 2026-03-07T01:32:17.173 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 60/156 2026-03-07T01:32:17.173 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 61/156 2026-03-07T01:32:17.173 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 62/156 2026-03-07T01:32:17.173 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 63/156 2026-03-07T01:32:17.173 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 64/156 2026-03-07T01:32:17.173 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 65/156 2026-03-07T01:32:17.173 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 66/156 2026-03-07T01:32:17.178 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 67/156 2026-03-07T01:32:17.178 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 68/156 2026-03-07T01:32:17.178 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 69/156 2026-03-07T01:32:17.178 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 70/156 2026-03-07T01:32:17.178 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 71/156 2026-03-07T01:32:17.178 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 72/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 73/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 74/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 75/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 76/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 77/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 78/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 79/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 80/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 81/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 82/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 83/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 84/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 85/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : re2-1:20211101-20.el9.x86_64 86/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 87/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 88/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : bzip2-1.0.8-10.el9_5.x86_64 89/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : c-ares-1.19.1-2.el9_4.x86_64 90/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : cryptsetup-2.7.2-4.el9.x86_64 91/156 2026-03-07T01:32:17.179 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : fuse-2.9.9-17.el9.x86_64 92/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 93/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 94/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libgfortran-11.5.0-11.el9.x86_64 95/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libquadmath-11.5.0-11.el9.x86_64 96/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : lmdb-libs-0.9.29-3.el9.x86_64 97/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mailcap-2.1.49-5.el9.0.2.noarch 98/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 99/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 100/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 101/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-cryptography-36.0.1-5.el9_6.x86_64 102/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-ply-3.11-14.el9.0.1.noarch 103/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 104/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.0.1.noarch 105/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-requests-2.25.1-10.el9_6.noarch 106/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-urllib3-1.26.5-6.el9_7.1.noarch 107/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : smartmontools-1:7.2-9.el9.x86_64 108/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : unzip-6.0-59.el9.x86_64 109/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : zip-3.0-35.el9.x86_64 110/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : boost-program-options-1.75.0-13.el9_7.x86_64 111/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : flexiblas-3.0.4-8.el9.0.1.x86_64 112/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.0.1.x86_64 113/156 2026-03-07T01:32:17.180 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.0.1.x86_64 114/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 115/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 116/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 117/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 118/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 119/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libxslt-1.1.34-13.el9_6.x86_64 120/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 121/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : lua-5.4.4-4.el9.x86_64 122/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 123/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 124/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : perl-Benchmark-1.23-481.1.el9_6.noarch 125/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : perl-Test-Harness-1:3.42-461.el9.noarch 126/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : protobuf-3.14.0-17.el9_7.x86_64 127/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 128/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-devel-3.9.23-2.el9.x86_64 129/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jinja2-2.11.3-8.el9_5.noarch 130/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 131/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 132/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 133/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 134/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-numpy-1:1.23.5-1.el9.x86_64 135/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-numpy-f2py-1:1.23.5-1.el9.x86_64 136/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 137/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-protobuf-3.14.0-17.el9_7.noarch 138/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-pyasn1-0.4.8-7.el9_7.noarch 139/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9_7.noarch 140/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 141/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 142/156 2026-03-07T01:32:17.181 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-toml-0.10.2-6.el9.0.1.noarch 143/156 2026-03-07T01:32:17.182 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : qatlib-24.09.0-1.el9.x86_64 144/156 2026-03-07T01:32:17.182 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : qatlib-service-24.09.0-1.el9.x86_64 145/156 2026-03-07T01:32:17.182 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 146/156 2026-03-07T01:32:17.182 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 147/156 2026-03-07T01:32:17.182 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 148/156 2026-03-07T01:32:17.182 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 149/156 2026-03-07T01:32:17.182 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 150/156 2026-03-07T01:32:17.182 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 151/156 2026-03-07T01:32:17.182 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : protobuf-compiler-3.14.0-17.el9_7.x86_64 152/156 2026-03-07T01:32:17.182 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : librados2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 153/156 2026-03-07T01:32:17.182 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 154/156 2026-03-07T01:32:17.182 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : librbd1-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_6 155/156 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 156/156 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout:Upgraded: 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: librados2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: librbd1-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout:Installed: 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: boost-program-options-1.75.0-13.el9_7.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: bzip2-1.0.8-10.el9_5.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: c-ares-1.19.1-2.el9_4.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-base-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-common-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-fuse-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-grafana-dashboards-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-immutable-object-cache-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mds-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-cephadm-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-dashboard-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-diskprediction-local-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-k8sevents-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-modules-core-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-rook-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mon-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-osd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-prometheus-alerts-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-radosgw-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-selinux-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-test-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ceph-volume-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: cephadm-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: cryptsetup-2.7.2-4.el9.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: flexiblas-3.0.4-8.el9.0.1.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: flexiblas-netlib-3.0.4-8.el9.0.1.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.0.1.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: fuse-2.9.9-17.el9.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: grpc-data-1.46.7-10.el9.noarch 2026-03-07T01:32:17.327 INFO:teuthology.orchestra.run.vm07.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: libarrow-9.0.0-15.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: libcephfs-devel-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: libcephfs2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: libcephsqlite-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: libconfig-1.7.2-9.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: libgfortran-11.5.0-11.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: libnbd-1.20.3-4.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: liboath-2.6.12-1.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: libquadmath-11.5.0-11.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: librados-devel-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: libradosstriper1-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: librgw2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: libunwind-1.6.2-1.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: libxslt-1.1.34-13.el9_6.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: lmdb-libs-0.9.29-3.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: lua-5.4.4-4.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: luarocks-3.9.2-5.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: mailcap-2.1.49-5.el9.0.2.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: nvme-cli-2.13-1.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: openblas-0.3.29-1.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: pciutils-3.7.0-7.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: perl-Benchmark-1.23-481.1.el9_6.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: perl-Test-Harness-1:3.42-461.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: protobuf-3.14.0-17.el9_7.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: protobuf-compiler-3.14.0-17.el9_7.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-babel-2.9.1-2.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-ceph-argparse-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-ceph-common-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-cephfs-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-cryptography-36.0.1-5.el9_6.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-devel-3.9.23-2.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-03-07T01:32:17.328 INFO:teuthology.orchestra.run.vm07.stdout: python3-jinja2-2.11.3-8.el9_5.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-mako-1.1.4-6.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-numpy-1:1.23.5-1.el9.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-numpy-f2py-1:1.23.5-1.el9.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-packaging-20.9-5.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-ply-3.11-14.el9.0.1.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-portend-3.1.0-2.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-protobuf-3.14.0-17.el9_7.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyasn1-0.4.8-7.el9_7.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyasn1-modules-0.4.8-7.el9_7.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-pycparser-2.20-6.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyparsing-2.4.7-9.el9.0.1.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-rados-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-rbd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-requests-2.25.1-10.el9_6.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-rgw-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-routes-2.5.1-5.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-rsa-4.9-2.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-saml-1.16.0-1.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-toml-0.10.2-6.el9.0.1.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-urllib3-1.26.5-6.el9_7.1.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-webob-1.8.8-2.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: qatlib-24.09.0-1.el9.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: qatlib-service-24.09.0-1.el9.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: rbd-fuse-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: rbd-mirror-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: rbd-nbd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: re2-1:20211101-20.el9.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: s3cmd-2.4.0-1.el9.noarch 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: smartmontools-1:7.2-9.el9.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: socat-1.7.4.1-8.el9.x86_64 2026-03-07T01:32:17.329 INFO:teuthology.orchestra.run.vm07.stdout: thrift-0.15.0-4.el9.x86_64 2026-03-07T01:32:17.330 INFO:teuthology.orchestra.run.vm07.stdout: unzip-6.0-59.el9.x86_64 2026-03-07T01:32:17.330 INFO:teuthology.orchestra.run.vm07.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-03-07T01:32:17.330 INFO:teuthology.orchestra.run.vm07.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-03-07T01:32:17.330 INFO:teuthology.orchestra.run.vm07.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-03-07T01:32:17.330 INFO:teuthology.orchestra.run.vm07.stdout: zip-3.0-35.el9.x86_64 2026-03-07T01:32:17.330 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:17.330 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:32:17.488 DEBUG:teuthology.parallel:result is None 2026-03-07T01:32:17.488 INFO:teuthology.task.install:Skipping version verification because we have custom repos... 2026-03-07T01:32:17.488 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-03-07T01:32:17.488 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:17.488 DEBUG:teuthology.orchestra.run.vm07:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-03-07T01:32:17.539 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-03-07T01:32:17.540 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:17.540 DEBUG:teuthology.orchestra.run.vm07:> sudo dd of=/usr/bin/daemon-helper 2026-03-07T01:32:17.614 DEBUG:teuthology.orchestra.run.vm07:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-03-07T01:32:17.698 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-03-07T01:32:17.698 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:17.698 DEBUG:teuthology.orchestra.run.vm07:> sudo dd of=/usr/bin/adjust-ulimits 2026-03-07T01:32:17.743 DEBUG:teuthology.orchestra.run.vm07:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-03-07T01:32:17.834 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-03-07T01:32:17.834 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:17.835 DEBUG:teuthology.orchestra.run.vm07:> sudo dd of=/usr/bin/stdin-killer 2026-03-07T01:32:17.865 DEBUG:teuthology.orchestra.run.vm07:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-03-07T01:32:17.947 INFO:teuthology.run_tasks:Running task ceph... 2026-03-07T01:32:17.998 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-03-07T01:32:17.998 DEBUG:teuthology.orchestra.run.vm07:> sudo chmod 777 /var/log/ceph 2026-03-07T01:32:18.029 INFO:tasks.ceph:Disabling ceph logrotate... 2026-03-07T01:32:18.030 DEBUG:teuthology.orchestra.run.vm07:> sudo rm -f -- /etc/logrotate.d/ceph 2026-03-07T01:32:18.100 INFO:tasks.ceph:Creating extra log directories... 2026-03-07T01:32:18.100 DEBUG:teuthology.orchestra.run.vm07:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-03-07T01:32:18.183 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-03-07T01:32:18.183 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw keystone accepted admin roles': 'admin', 'rgw keystone accepted roles': 'admin,member', 'rgw keystone admin domain': 'Default', 'rgw keystone admin password': 'ADMIN', 'rgw keystone admin project': 'admin', 'rgw keystone admin user': 'admin', 'rgw keystone api version': 3, 'rgw keystone implicit tenants': True, 'rgw s3 auth order': 'sts, external, local', 'rgw s3 auth use keystone': True, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw swift account in url': True, 'rgw swift enforce content length': True, 'rgw swift versioning enabled': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd mclock iops capacity threshold hdd': 49000, 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-03-07T01:32:18.183 INFO:tasks.ceph:ctx.config {'archive_path': '/archive/irq0-2026-03-06_21:40:09-rgw-cobaltcore-storage-v19.2.3-fasttrack-5-none-default-vps/439', 'branch': 'cobaltcore-storage-v19.2.3-fasttrack-5', 'description': 'rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides rocky_latest s3tests-branch tasks/s3/{auth-order/external-local s3tests}}', 'email': None, 'first_in_suite': False, 'flavor': 'default', 'job_id': '439', 'last_in_suite': False, 'machine_type': 'vps', 'name': 'irq0-2026-03-06_21:40:09-rgw-cobaltcore-storage-v19.2.3-fasttrack-5-none-default-vps', 'no_nested_subset': False, 'os_type': 'rocky', 'os_version': '9.7', 'overrides': {'admin_socket': {'branch': 'cobaltcore-storage-v19.2.3-fasttrack-5'}, 'ansible.cephlab': {'branch': 'main', 'repo': 'https://github.com/kshtsk/ceph-cm-ansible.git', 'skip_tags': 'nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs', 'vars': {'timezone': 'Europe/Berlin'}}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw keystone accepted admin roles': 'admin', 'rgw keystone accepted roles': 'admin,member', 'rgw keystone admin domain': 'Default', 'rgw keystone admin password': 'ADMIN', 'rgw keystone admin project': 'admin', 'rgw keystone admin user': 'admin', 'rgw keystone api version': 3, 'rgw keystone implicit tenants': True, 'rgw s3 auth order': 'sts, external, local', 'rgw s3 auth use keystone': True, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw swift account in url': True, 'rgw swift enforce content length': True, 'rgw swift versioning enabled': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd mclock iops capacity threshold hdd': 49000, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '340d3c24fc6ae7529322dc7ccee6c6cb2589da0a'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'cephadm': {'cephadm_binary_url': 'https://download.ceph.com/rpm-19.2.3/el9/noarch/cephadm', 'containers': {'image': 'harbor.clyso.com/custom-ceph/ceph/ceph:cobaltcore-storage-v19.2.3-fasttrack-5'}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '340d3c24fc6ae7529322dc7ccee6c6cb2589da0a'}, 'extra_system_packages': {'deb': ['python3-xmltodict', 's3cmd'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 's3cmd']}, 'repos': [{'name': 'ceph-source', 'priority': 1, 'url': 'https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/SRPMS'}, {'name': 'ceph-noarch', 'priority': 1, 'url': 'https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/noarch'}, {'name': 'ceph', 'priority': 1, 'url': 'https://s3.clyso.com/ces-packages/components/ceph/rpm-19.2.3-39-g340d3c24fc6/el9.clyso/x86_64'}]}, 'keystone': {'client.0': {'ec2 credentials': [{'project': 's3tests', 'user': 's3tests-main'}], 'projects': [{'description': 's3tests project', 'name': 's3tests'}], 'role-mappings': [{'name': 'member', 'project': 's3tests', 'user': 's3tests-main'}], 'roles': [{'name': 'member'}], 'users': [{'name': 's3tests-main', 'password': 'SECRET', 'project': 's3tests'}]}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-squid'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'tt-fasttrack-5-kafka', 'sha1': 'de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0'}}, 'owner': 'irq0', 'priority': 1000, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 8950, 'sha1': '340d3c24fc6ae7529322dc7ccee6c6cb2589da0a', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'tt-fasttrack-5-kafka', 'suite_path': '/home/teuthos/src/github.com_kshtsk_ceph_de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/kshtsk/ceph.git', 'suite_sha1': 'de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0', 'targets': {'vm07.local': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIbObpm0EnTiZ2Z7WgHw3cs6JKnne74BItP0pjr4YhxsJQpjYIa/9cksWkVBGp4mqSRoiorliECpmM3e3cBK/mA='}, 'tasks': [{'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'tox': ['client.0']}, {'keystone': {'client.0': {'force-branch': 'stable/2025.1', 'services': [{'description': 'Swift Service', 'name': 'swift', 'type': 'object-store'}]}}}, {'rgw': {'client.0': {'use-keystone-role': 'client.0'}}}, {'s3tests': {'client.0': {'keystone users': {'s3 main': {'client': 'client.0', 'project': 's3tests', 'user': 's3tests-main'}}, 'rgw_server': 'client.0'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'clyso-debian-13', 'teuthology_repo': 'https://github.com/clyso/teuthology', 'teuthology_sha1': '1c580df7a9c7c2aadc272da296344fd99f27c444', 'timestamp': '2026-03-06_21:40:09', 'tube': 'vps', 'user': 'irq0', 'verbose': False, 'worker_log': '/home/teuthos/.teuthology/dispatcher/dispatcher.vps.43333'} 2026-03-07T01:32:18.183 DEBUG:teuthology.orchestra.run.vm07:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-03-07T01:32:18.242 DEBUG:teuthology.orchestra.run.vm07:> sudo install -d -m0777 -- /var/run/ceph 2026-03-07T01:32:18.312 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:18.312 DEBUG:teuthology.orchestra.run.vm07:> dd if=/scratch_devs of=/dev/stdout 2026-03-07T01:32:18.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-07T01:32:18.374 DEBUG:teuthology.orchestra.run.vm07:> ls /dev/[sv]d? 2026-03-07T01:32:18.437 INFO:teuthology.orchestra.run.vm07.stdout:/dev/vda 2026-03-07T01:32:18.437 INFO:teuthology.orchestra.run.vm07.stdout:/dev/vdb 2026-03-07T01:32:18.437 INFO:teuthology.orchestra.run.vm07.stdout:/dev/vdc 2026-03-07T01:32:18.438 INFO:teuthology.orchestra.run.vm07.stdout:/dev/vdd 2026-03-07T01:32:18.438 INFO:teuthology.orchestra.run.vm07.stdout:/dev/vde 2026-03-07T01:32:18.438 WARNING:teuthology.misc:Removing root device: /dev/vda from device list 2026-03-07T01:32:18.438 DEBUG:teuthology.misc:devs=['/dev/vdb', '/dev/vdc', '/dev/vdd', '/dev/vde'] 2026-03-07T01:32:18.438 DEBUG:teuthology.orchestra.run.vm07:> stat /dev/vdb 2026-03-07T01:32:18.495 INFO:teuthology.orchestra.run.vm07.stdout: File: /dev/vdb 2026-03-07T01:32:18.495 INFO:teuthology.orchestra.run.vm07.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-07T01:32:18.495 INFO:teuthology.orchestra.run.vm07.stdout:Device: 5h/5d Inode: 224 Links: 1 Device type: fc,10 2026-03-07T01:32:18.495 INFO:teuthology.orchestra.run.vm07.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-07T01:32:18.495 INFO:teuthology.orchestra.run.vm07.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-07T01:32:18.495 INFO:teuthology.orchestra.run.vm07.stdout:Access: 2026-03-07 01:31:57.518148584 +0100 2026-03-07T01:32:18.495 INFO:teuthology.orchestra.run.vm07.stdout:Modify: 2026-03-07 01:31:57.518148584 +0100 2026-03-07T01:32:18.495 INFO:teuthology.orchestra.run.vm07.stdout:Change: 2026-03-07 01:31:57.518148584 +0100 2026-03-07T01:32:18.495 INFO:teuthology.orchestra.run.vm07.stdout: Birth: 2026-03-07 01:28:12.189000000 +0100 2026-03-07T01:32:18.495 DEBUG:teuthology.orchestra.run.vm07:> sudo dd if=/dev/vdb of=/dev/null count=1 2026-03-07T01:32:18.562 INFO:teuthology.orchestra.run.vm07.stderr:1+0 records in 2026-03-07T01:32:18.562 INFO:teuthology.orchestra.run.vm07.stderr:1+0 records out 2026-03-07T01:32:18.562 INFO:teuthology.orchestra.run.vm07.stderr:512 bytes copied, 0.000180469 s, 2.8 MB/s 2026-03-07T01:32:18.563 DEBUG:teuthology.orchestra.run.vm07:> ! mount | grep -v devtmpfs | grep -q /dev/vdb 2026-03-07T01:32:18.627 DEBUG:teuthology.orchestra.run.vm07:> stat /dev/vdc 2026-03-07T01:32:18.690 INFO:teuthology.orchestra.run.vm07.stdout: File: /dev/vdc 2026-03-07T01:32:18.690 INFO:teuthology.orchestra.run.vm07.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-07T01:32:18.690 INFO:teuthology.orchestra.run.vm07.stdout:Device: 5h/5d Inode: 258 Links: 1 Device type: fc,20 2026-03-07T01:32:18.690 INFO:teuthology.orchestra.run.vm07.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-07T01:32:18.690 INFO:teuthology.orchestra.run.vm07.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-07T01:32:18.690 INFO:teuthology.orchestra.run.vm07.stdout:Access: 2026-03-07 01:31:57.504148577 +0100 2026-03-07T01:32:18.690 INFO:teuthology.orchestra.run.vm07.stdout:Modify: 2026-03-07 01:31:57.504148577 +0100 2026-03-07T01:32:18.690 INFO:teuthology.orchestra.run.vm07.stdout:Change: 2026-03-07 01:31:57.504148577 +0100 2026-03-07T01:32:18.690 INFO:teuthology.orchestra.run.vm07.stdout: Birth: 2026-03-07 01:28:12.205000000 +0100 2026-03-07T01:32:18.690 DEBUG:teuthology.orchestra.run.vm07:> sudo dd if=/dev/vdc of=/dev/null count=1 2026-03-07T01:32:18.758 INFO:teuthology.orchestra.run.vm07.stderr:1+0 records in 2026-03-07T01:32:18.758 INFO:teuthology.orchestra.run.vm07.stderr:1+0 records out 2026-03-07T01:32:18.758 INFO:teuthology.orchestra.run.vm07.stderr:512 bytes copied, 0.000169438 s, 3.0 MB/s 2026-03-07T01:32:18.759 DEBUG:teuthology.orchestra.run.vm07:> ! mount | grep -v devtmpfs | grep -q /dev/vdc 2026-03-07T01:32:18.823 DEBUG:teuthology.orchestra.run.vm07:> stat /dev/vdd 2026-03-07T01:32:18.882 INFO:teuthology.orchestra.run.vm07.stdout: File: /dev/vdd 2026-03-07T01:32:18.882 INFO:teuthology.orchestra.run.vm07.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-07T01:32:18.882 INFO:teuthology.orchestra.run.vm07.stdout:Device: 5h/5d Inode: 259 Links: 1 Device type: fc,30 2026-03-07T01:32:18.882 INFO:teuthology.orchestra.run.vm07.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-07T01:32:18.882 INFO:teuthology.orchestra.run.vm07.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-07T01:32:18.882 INFO:teuthology.orchestra.run.vm07.stdout:Access: 2026-03-07 01:31:57.619148635 +0100 2026-03-07T01:32:18.882 INFO:teuthology.orchestra.run.vm07.stdout:Modify: 2026-03-07 01:31:57.619148635 +0100 2026-03-07T01:32:18.882 INFO:teuthology.orchestra.run.vm07.stdout:Change: 2026-03-07 01:31:57.619148635 +0100 2026-03-07T01:32:18.882 INFO:teuthology.orchestra.run.vm07.stdout: Birth: 2026-03-07 01:28:12.214000000 +0100 2026-03-07T01:32:18.883 DEBUG:teuthology.orchestra.run.vm07:> sudo dd if=/dev/vdd of=/dev/null count=1 2026-03-07T01:32:18.949 INFO:teuthology.orchestra.run.vm07.stderr:1+0 records in 2026-03-07T01:32:18.949 INFO:teuthology.orchestra.run.vm07.stderr:1+0 records out 2026-03-07T01:32:18.949 INFO:teuthology.orchestra.run.vm07.stderr:512 bytes copied, 0.000161071 s, 3.2 MB/s 2026-03-07T01:32:18.950 DEBUG:teuthology.orchestra.run.vm07:> ! mount | grep -v devtmpfs | grep -q /dev/vdd 2026-03-07T01:32:19.015 DEBUG:teuthology.orchestra.run.vm07:> stat /dev/vde 2026-03-07T01:32:19.075 INFO:teuthology.orchestra.run.vm07.stdout: File: /dev/vde 2026-03-07T01:32:19.075 INFO:teuthology.orchestra.run.vm07.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-07T01:32:19.075 INFO:teuthology.orchestra.run.vm07.stdout:Device: 5h/5d Inode: 260 Links: 1 Device type: fc,40 2026-03-07T01:32:19.075 INFO:teuthology.orchestra.run.vm07.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-07T01:32:19.075 INFO:teuthology.orchestra.run.vm07.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-07T01:32:19.075 INFO:teuthology.orchestra.run.vm07.stdout:Access: 2026-03-07 01:31:57.516148583 +0100 2026-03-07T01:32:19.075 INFO:teuthology.orchestra.run.vm07.stdout:Modify: 2026-03-07 01:31:57.516148583 +0100 2026-03-07T01:32:19.075 INFO:teuthology.orchestra.run.vm07.stdout:Change: 2026-03-07 01:31:57.516148583 +0100 2026-03-07T01:32:19.075 INFO:teuthology.orchestra.run.vm07.stdout: Birth: 2026-03-07 01:28:12.250000000 +0100 2026-03-07T01:32:19.075 DEBUG:teuthology.orchestra.run.vm07:> sudo dd if=/dev/vde of=/dev/null count=1 2026-03-07T01:32:19.151 INFO:teuthology.orchestra.run.vm07.stderr:1+0 records in 2026-03-07T01:32:19.151 INFO:teuthology.orchestra.run.vm07.stderr:1+0 records out 2026-03-07T01:32:19.151 INFO:teuthology.orchestra.run.vm07.stderr:512 bytes copied, 0.000140994 s, 3.6 MB/s 2026-03-07T01:32:19.152 DEBUG:teuthology.orchestra.run.vm07:> ! mount | grep -v devtmpfs | grep -q /dev/vde 2026-03-07T01:32:19.218 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vdb', 'osd.1': '/dev/vdc', 'osd.2': '/dev/vdd'} 2026-03-07T01:32:19.219 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@vm07.local'): {'osd.0': '/dev/vdb', 'osd.1': '/dev/vdc', 'osd.2': '/dev/vdd'}} 2026-03-07T01:32:19.219 INFO:tasks.ceph:Generating config... 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] debug rgw = 20 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw keystone accepted admin roles = admin 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw keystone accepted roles = admin,member 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw keystone admin domain = Default 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw keystone admin password = ADMIN 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw keystone admin project = admin 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw keystone admin user = admin 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw keystone api version = 3 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw keystone implicit tenants = True 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw s3 auth order = sts, external, local 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw s3 auth use keystone = True 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw swift account in url = True 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw swift enforce content length = True 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] rgw swift versioning enabled = True 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] setgroup = ceph 2026-03-07T01:32:19.219 INFO:tasks.ceph:[client] setuser = ceph 2026-03-07T01:32:19.220 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2026-03-07T01:32:19.220 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2026-03-07T01:32:19.220 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-03-07T01:32:19.220 INFO:tasks.ceph:[mgr] debug ms = 1 2026-03-07T01:32:19.220 INFO:tasks.ceph:[mon] debug mon = 20 2026-03-07T01:32:19.220 INFO:tasks.ceph:[mon] debug ms = 1 2026-03-07T01:32:19.220 INFO:tasks.ceph:[mon] debug paxos = 20 2026-03-07T01:32:19.220 INFO:tasks.ceph:[osd] debug ms = 1 2026-03-07T01:32:19.220 INFO:tasks.ceph:[osd] debug osd = 20 2026-03-07T01:32:19.220 INFO:tasks.ceph:[osd] osd mclock iops capacity threshold hdd = 49000 2026-03-07T01:32:19.220 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-03-07T01:32:19.220 INFO:tasks.ceph:Setting up mon.a... 2026-03-07T01:32:19.220 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-03-07T01:32:19.301 INFO:teuthology.orchestra.run.vm07.stdout:creating /etc/ceph/ceph.keyring 2026-03-07T01:32:19.304 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-03-07T01:32:19.395 DEBUG:teuthology.orchestra.run.vm07:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-03-07T01:32:19.421 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '192.168.123.107')] 2026-03-07T01:32:19.421 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '192.168.123.107', 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20, 'osd mclock iops capacity threshold hdd': 49000, 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw keystone accepted admin roles': 'admin', 'rgw keystone accepted roles': 'admin,member', 'rgw keystone admin domain': 'Default', 'rgw keystone admin password': 'ADMIN', 'rgw keystone admin project': 'admin', 'rgw keystone admin user': 'admin', 'rgw keystone api version': 3, 'rgw keystone implicit tenants': True, 'rgw s3 auth order': 'sts, external, local', 'rgw s3 auth use keystone': True, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw swift account in url': True, 'rgw swift enforce content length': True, 'rgw swift versioning enabled': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2026-03-07T01:32:19.422 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:19.422 DEBUG:teuthology.orchestra.run.vm07:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-03-07T01:32:19.489 DEBUG:teuthology.orchestra.run.vm07:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 192.168.123.107 --print /home/ubuntu/cephtest/ceph.monmap 2026-03-07T01:32:19.570 INFO:teuthology.orchestra.run.vm07.stderr:ignoring --setuser ceph since I am not root 2026-03-07T01:32:19.570 INFO:teuthology.orchestra.run.vm07.stderr:ignoring --setgroup ceph since I am not root 2026-03-07T01:32:19.571 INFO:teuthology.orchestra.run.vm07.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-03-07T01:32:19.571 INFO:teuthology.orchestra.run.vm07.stdout:monmaptool: generated fsid d293b3a5-efef-4619-a378-e22bf171f656 2026-03-07T01:32:19.571 INFO:teuthology.orchestra.run.vm07.stdout:setting min_mon_release = quincy 2026-03-07T01:32:19.571 INFO:teuthology.orchestra.run.vm07.stdout:epoch 0 2026-03-07T01:32:19.571 INFO:teuthology.orchestra.run.vm07.stdout:fsid d293b3a5-efef-4619-a378-e22bf171f656 2026-03-07T01:32:19.571 INFO:teuthology.orchestra.run.vm07.stdout:last_changed 2026-03-07T01:32:19.569929+0100 2026-03-07T01:32:19.571 INFO:teuthology.orchestra.run.vm07.stdout:created 2026-03-07T01:32:19.569929+0100 2026-03-07T01:32:19.571 INFO:teuthology.orchestra.run.vm07.stdout:min_mon_release 17 (quincy) 2026-03-07T01:32:19.571 INFO:teuthology.orchestra.run.vm07.stdout:election_strategy: 1 2026-03-07T01:32:19.571 INFO:teuthology.orchestra.run.vm07.stdout:0: [v2:192.168.123.107:3300/0,v1:192.168.123.107:6789/0] mon.a 2026-03-07T01:32:19.571 INFO:teuthology.orchestra.run.vm07.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-03-07T01:32:19.573 DEBUG:teuthology.orchestra.run.vm07:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-03-07T01:32:19.632 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d293b3a5-efef-4619-a378-e22bf171f656... 2026-03-07T01:32:19.633 DEBUG:teuthology.orchestra.run.vm07:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout:[global] 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: chdir = "" 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: auth supported = cephx 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: filestore xattr use omap = true 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: mon clock drift allowed = 1.000 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: osd crush chooseleaf type = 0 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: auth debug = true 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: ms die on old message = true 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: ms die on bug = true 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: mon max pg per osd = 10000 # >= luminous 2026-03-07T01:32:19.719 INFO:teuthology.orchestra.run.vm07.stdout: mon pg warn max object skew = 0 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: # disable pg_autoscaler by default for new pools 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd_pool_default_pg_autoscale_mode = off 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd pool default size = 2 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: mon osd allow primary affinity = true 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: mon osd allow pg remap = true 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: mon warn on legacy crush tunables = false 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: mon warn on crush straw calc version zero = false 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: mon warn on no sortbitwise = false 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: mon warn on osd down out interval zero = false 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: mon warn on too few osds = false 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: mon_warn_on_pool_no_redundancy = false 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: mon_allow_pool_size_one = true 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd default data pool replay window = 5 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: mon allow pool delete = true 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: mon cluster log file level = debug 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: debug asserts on shutdown = true 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: mon health detail to clog = false 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: mon host = 192.168.123.107 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd_max_pg_log_entries = 10 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd_min_pg_log_entries = 10 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: fsid = d293b3a5-efef-4619-a378-e22bf171f656 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout:[osd] 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd journal size = 100 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd scrub load threshold = 5.0 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd scrub max interval = 600 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd mclock profile = high_recovery_ops 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd recover clone overlap = true 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd recovery max chunk = 1048576 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd debug shutdown = true 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd debug op order = true 2026-03-07T01:32:19.720 INFO:teuthology.orchestra.run.vm07.stdout: osd debug verify stray on activate = true 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: osd debug trim objects = true 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: osd open classes on start = true 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: osd debug pg log writeout = true 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: osd deep scrub update digest min age = 30 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: osd map max advance = 10 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: journal zero on create = true 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: filestore ondisk finisher threads = 3 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: filestore apply finisher threads = 3 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: bdev debug aio = true 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: osd debug misdirected ops = true 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: debug ms = 1 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: debug osd = 20 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: osd mclock iops capacity threshold hdd = 49000 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: osd shutdown pgref assert = True 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout:[mgr] 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: debug ms = 1 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: debug mgr = 20 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: debug mon = 20 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: debug auth = 20 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: mon reweight min pgs per osd = 4 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: mon reweight min bytes per osd = 10 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: mgr/telemetry/nag = false 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout:[mon] 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: debug ms = 1 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: debug mon = 20 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: debug paxos = 20 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: debug auth = 20 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: mon data avail warn = 5 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: mon mgr mkfs grace = 240 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: mon reweight min pgs per osd = 4 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: mon osd reporter subtree level = osd 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: mon osd prime pg temp = true 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: mon reweight min bytes per osd = 10 2026-03-07T01:32:19.721 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: auth mon ticket ttl = 660 # 11m 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: auth service ticket ttl = 240 # 4m 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: # don't complain about insecure global_id in the test suite 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: # 1m isn't quite enough 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: mon_down_mkfs_grace = 2m 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: mon_warn_on_filestore_osds = false 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout:[client] 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw cache enabled = true 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw enable ops log = true 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw enable usage log = true 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: debug rgw = 20 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw crypt require ssl = False 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw crypt s3 kms backend = testing 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw keystone accepted admin roles = admin 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw keystone accepted roles = "admin,member" 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw keystone admin domain = Default 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw keystone admin password = ADMIN 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw keystone admin project = admin 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw keystone admin user = admin 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw keystone api version = 3 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw keystone implicit tenants = True 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw s3 auth order = "sts, external, local" 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw s3 auth use keystone = True 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw s3 auth use sts = True 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw sts key = abcdefghijklmnop 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw swift account in url = True 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw swift enforce content length = True 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: rgw swift versioning enabled = True 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: setgroup = ceph 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout: setuser = ceph 2026-03-07T01:32:19.722 INFO:teuthology.orchestra.run.vm07.stdout:[mon.a] 2026-03-07T01:32:19.732 INFO:tasks.ceph:Creating admin key on mon.a... 2026-03-07T01:32:19.733 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-03-07T01:32:19.784 INFO:tasks.ceph:Copying monmap to all nodes... 2026-03-07T01:32:19.784 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:19.784 DEBUG:teuthology.orchestra.run.vm07:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-03-07T01:32:19.808 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:19.808 DEBUG:teuthology.orchestra.run.vm07:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-03-07T01:32:19.869 INFO:tasks.ceph:Sending monmap to node ubuntu@vm07.local 2026-03-07T01:32:19.869 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:19.869 DEBUG:teuthology.orchestra.run.vm07:> sudo dd of=/etc/ceph/ceph.keyring 2026-03-07T01:32:19.869 DEBUG:teuthology.orchestra.run.vm07:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-03-07T01:32:19.950 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:19.950 DEBUG:teuthology.orchestra.run.vm07:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-03-07T01:32:20.016 INFO:tasks.ceph:Setting up mon nodes... 2026-03-07T01:32:20.016 INFO:tasks.ceph:Setting up mgr nodes... 2026-03-07T01:32:20.016 DEBUG:teuthology.orchestra.run.vm07:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-03-07T01:32:20.128 INFO:teuthology.orchestra.run.vm07.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-03-07T01:32:20.135 INFO:tasks.ceph:Setting up mds nodes... 2026-03-07T01:32:20.135 INFO:tasks.ceph_client:Setting up client nodes... 2026-03-07T01:32:20.135 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-03-07T01:32:20.174 INFO:teuthology.orchestra.run.vm07.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-03-07T01:32:20.187 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-03-07T01:32:20.187 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@vm07.local'): {'osd.0': '/dev/vdb', 'osd.1': '/dev/vdc', 'osd.2': '/dev/vdd'}} 2026-03-07T01:32:20.187 DEBUG:teuthology.orchestra.run.vm07:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-03-07T01:32:20.264 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vdb', 'osd.1': '/dev/vdc', 'osd.2': '/dev/vdd'} 2026-03-07T01:32:20.265 INFO:tasks.ceph:role: osd.0 2026-03-07T01:32:20.265 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vdb on ubuntu@vm07.local 2026-03-07T01:32:20.265 DEBUG:teuthology.orchestra.run.vm07:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vdb 2026-03-07T01:32:20.343 INFO:teuthology.orchestra.run.vm07.stdout:meta-data=/dev/vdb isize=2048 agcount=4, agsize=1310720 blks 2026-03-07T01:32:20.343 INFO:teuthology.orchestra.run.vm07.stdout: = sectsz=512 attr=2, projid32bit=1 2026-03-07T01:32:20.343 INFO:teuthology.orchestra.run.vm07.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-03-07T01:32:20.343 INFO:teuthology.orchestra.run.vm07.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-03-07T01:32:20.343 INFO:teuthology.orchestra.run.vm07.stdout:data = bsize=4096 blocks=5242880, imaxpct=25 2026-03-07T01:32:20.343 INFO:teuthology.orchestra.run.vm07.stdout: = sunit=0 swidth=0 blks 2026-03-07T01:32:20.343 INFO:teuthology.orchestra.run.vm07.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-03-07T01:32:20.343 INFO:teuthology.orchestra.run.vm07.stdout:log =internal log bsize=4096 blocks=16384, version=2 2026-03-07T01:32:20.343 INFO:teuthology.orchestra.run.vm07.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2026-03-07T01:32:20.343 INFO:teuthology.orchestra.run.vm07.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-03-07T01:32:20.391 INFO:teuthology.orchestra.run.vm07.stdout:Discarding blocks...Done. 2026-03-07T01:32:20.393 INFO:tasks.ceph:mount /dev/vdb on ubuntu@vm07.local -o noatime 2026-03-07T01:32:20.393 DEBUG:teuthology.orchestra.run.vm07:> sudo mount -t xfs -o noatime /dev/vdb /var/lib/ceph/osd/ceph-0 2026-03-07T01:32:20.486 DEBUG:teuthology.orchestra.run.vm07:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-03-07T01:32:20.525 DEBUG:teuthology.orchestra.run.vm07:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-03-07T01:32:20.602 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vdb', 'osd.1': '/dev/vdc', 'osd.2': '/dev/vdd'} 2026-03-07T01:32:20.602 INFO:tasks.ceph:role: osd.1 2026-03-07T01:32:20.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vdc on ubuntu@vm07.local 2026-03-07T01:32:20.602 DEBUG:teuthology.orchestra.run.vm07:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vdc 2026-03-07T01:32:20.682 INFO:teuthology.orchestra.run.vm07.stdout:meta-data=/dev/vdc isize=2048 agcount=4, agsize=1310720 blks 2026-03-07T01:32:20.682 INFO:teuthology.orchestra.run.vm07.stdout: = sectsz=512 attr=2, projid32bit=1 2026-03-07T01:32:20.682 INFO:teuthology.orchestra.run.vm07.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-03-07T01:32:20.682 INFO:teuthology.orchestra.run.vm07.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-03-07T01:32:20.682 INFO:teuthology.orchestra.run.vm07.stdout:data = bsize=4096 blocks=5242880, imaxpct=25 2026-03-07T01:32:20.682 INFO:teuthology.orchestra.run.vm07.stdout: = sunit=0 swidth=0 blks 2026-03-07T01:32:20.682 INFO:teuthology.orchestra.run.vm07.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-03-07T01:32:20.682 INFO:teuthology.orchestra.run.vm07.stdout:log =internal log bsize=4096 blocks=16384, version=2 2026-03-07T01:32:20.682 INFO:teuthology.orchestra.run.vm07.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2026-03-07T01:32:20.682 INFO:teuthology.orchestra.run.vm07.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-03-07T01:32:20.699 INFO:teuthology.orchestra.run.vm07.stdout:Discarding blocks...Done. 2026-03-07T01:32:20.704 INFO:tasks.ceph:mount /dev/vdc on ubuntu@vm07.local -o noatime 2026-03-07T01:32:20.704 DEBUG:teuthology.orchestra.run.vm07:> sudo mount -t xfs -o noatime /dev/vdc /var/lib/ceph/osd/ceph-1 2026-03-07T01:32:20.791 DEBUG:teuthology.orchestra.run.vm07:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-03-07T01:32:20.836 DEBUG:teuthology.orchestra.run.vm07:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-03-07T01:32:20.901 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vdb', 'osd.1': '/dev/vdc', 'osd.2': '/dev/vdd'} 2026-03-07T01:32:20.902 INFO:tasks.ceph:role: osd.2 2026-03-07T01:32:20.902 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vdd on ubuntu@vm07.local 2026-03-07T01:32:20.902 DEBUG:teuthology.orchestra.run.vm07:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vdd 2026-03-07T01:32:20.971 INFO:teuthology.orchestra.run.vm07.stdout:meta-data=/dev/vdd isize=2048 agcount=4, agsize=1310720 blks 2026-03-07T01:32:20.971 INFO:teuthology.orchestra.run.vm07.stdout: = sectsz=512 attr=2, projid32bit=1 2026-03-07T01:32:20.971 INFO:teuthology.orchestra.run.vm07.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-03-07T01:32:20.971 INFO:teuthology.orchestra.run.vm07.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-03-07T01:32:20.971 INFO:teuthology.orchestra.run.vm07.stdout:data = bsize=4096 blocks=5242880, imaxpct=25 2026-03-07T01:32:20.971 INFO:teuthology.orchestra.run.vm07.stdout: = sunit=0 swidth=0 blks 2026-03-07T01:32:20.971 INFO:teuthology.orchestra.run.vm07.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-03-07T01:32:20.971 INFO:teuthology.orchestra.run.vm07.stdout:log =internal log bsize=4096 blocks=16384, version=2 2026-03-07T01:32:20.971 INFO:teuthology.orchestra.run.vm07.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2026-03-07T01:32:20.971 INFO:teuthology.orchestra.run.vm07.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-03-07T01:32:20.976 INFO:teuthology.orchestra.run.vm07.stdout:Discarding blocks...Done. 2026-03-07T01:32:20.978 INFO:tasks.ceph:mount /dev/vdd on ubuntu@vm07.local -o noatime 2026-03-07T01:32:20.978 DEBUG:teuthology.orchestra.run.vm07:> sudo mount -t xfs -o noatime /dev/vdd /var/lib/ceph/osd/ceph-2 2026-03-07T01:32:21.060 DEBUG:teuthology.orchestra.run.vm07:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-03-07T01:32:21.143 DEBUG:teuthology.orchestra.run.vm07:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-03-07T01:32:21.247 INFO:teuthology.orchestra.run.vm07.stderr:2026-03-07T01:32:21.242+0100 7f5efa2ec780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-03-07T01:32:21.247 INFO:teuthology.orchestra.run.vm07.stderr:2026-03-07T01:32:21.243+0100 7f5efa2ec780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-03-07T01:32:21.247 INFO:teuthology.orchestra.run.vm07.stderr:2026-03-07T01:32:21.243+0100 7f5efa2ec780 -1 bdev(0x563f37fe1800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-03-07T01:32:21.247 INFO:teuthology.orchestra.run.vm07.stderr:2026-03-07T01:32:21.243+0100 7f5efa2ec780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-03-07T01:32:23.605 DEBUG:teuthology.orchestra.run.vm07:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-03-07T01:32:23.635 DEBUG:teuthology.orchestra.run.vm07:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-03-07T01:32:23.715 INFO:teuthology.orchestra.run.vm07.stderr:2026-03-07T01:32:23.713+0100 7f650120f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-03-07T01:32:23.715 INFO:teuthology.orchestra.run.vm07.stderr:2026-03-07T01:32:23.713+0100 7f650120f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-03-07T01:32:23.715 INFO:teuthology.orchestra.run.vm07.stderr:2026-03-07T01:32:23.713+0100 7f650120f780 -1 bdev(0x556893045800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-03-07T01:32:23.715 INFO:teuthology.orchestra.run.vm07.stderr:2026-03-07T01:32:23.713+0100 7f650120f780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-03-07T01:32:26.341 DEBUG:teuthology.orchestra.run.vm07:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-03-07T01:32:26.408 DEBUG:teuthology.orchestra.run.vm07:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-03-07T01:32:26.490 INFO:teuthology.orchestra.run.vm07.stderr:2026-03-07T01:32:26.488+0100 7fef0f19b780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-03-07T01:32:26.491 INFO:teuthology.orchestra.run.vm07.stderr:2026-03-07T01:32:26.488+0100 7fef0f19b780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-03-07T01:32:26.491 INFO:teuthology.orchestra.run.vm07.stderr:2026-03-07T01:32:26.488+0100 7fef0f19b780 -1 bdev(0x55691b617800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-03-07T01:32:26.491 INFO:teuthology.orchestra.run.vm07.stderr:2026-03-07T01:32:26.488+0100 7fef0f19b780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-03-07T01:32:28.623 DEBUG:teuthology.orchestra.run.vm07:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-03-07T01:32:28.648 INFO:tasks.ceph:Reading keys from all nodes... 2026-03-07T01:32:28.648 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:28.648 DEBUG:teuthology.orchestra.run.vm07:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-03-07T01:32:28.715 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:28.715 DEBUG:teuthology.orchestra.run.vm07:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-03-07T01:32:28.789 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:28.789 DEBUG:teuthology.orchestra.run.vm07:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-03-07T01:32:28.860 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:28.861 DEBUG:teuthology.orchestra.run.vm07:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-03-07T01:32:28.931 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:28.931 DEBUG:teuthology.orchestra.run.vm07:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-03-07T01:32:28.992 INFO:tasks.ceph:Adding keys to all mons... 2026-03-07T01:32:28.992 DEBUG:teuthology.orchestra.run.vm07:> sudo tee -a /etc/ceph/ceph.keyring 2026-03-07T01:32:29.063 INFO:teuthology.orchestra.run.vm07.stdout:[mgr.x] 2026-03-07T01:32:29.063 INFO:teuthology.orchestra.run.vm07.stdout: key = AQAUcqtpXACaBxAAx7hKASLYCbanJ/Ezod+dlg== 2026-03-07T01:32:29.063 INFO:teuthology.orchestra.run.vm07.stdout:[osd.0] 2026-03-07T01:32:29.063 INFO:teuthology.orchestra.run.vm07.stdout: key = AQAVcqtpoX+LDhAADpkfFHGlqtbF2u+k/cagnQ== 2026-03-07T01:32:29.063 INFO:teuthology.orchestra.run.vm07.stdout:[osd.1] 2026-03-07T01:32:29.063 INFO:teuthology.orchestra.run.vm07.stdout: key = AQAXcqtp7RWTKhAAIOCTaPBBMBIJPuvYrRjb1Q== 2026-03-07T01:32:29.063 INFO:teuthology.orchestra.run.vm07.stdout:[osd.2] 2026-03-07T01:32:29.063 INFO:teuthology.orchestra.run.vm07.stdout: key = AQAacqtptEMrHRAAaP1ulV2QE1+v2hQU9rfjgw== 2026-03-07T01:32:29.063 INFO:teuthology.orchestra.run.vm07.stdout:[client.0] 2026-03-07T01:32:29.064 INFO:teuthology.orchestra.run.vm07.stdout: key = AQAUcqtpjDlIChAASMVmDJqCnH7c2jBFkEdU8Q== 2026-03-07T01:32:29.065 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-03-07T01:32:29.148 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-03-07T01:32:29.190 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-03-07T01:32:29.278 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-03-07T01:32:29.322 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-03-07T01:32:29.411 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-03-07T01:32:29.411 DEBUG:teuthology.orchestra.run.vm07:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-03-07T01:32:29.438 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-03-07T01:32:30.312 DEBUG:teuthology.orchestra.run.vm07:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-03-07T01:32:30.342 DEBUG:teuthology.orchestra.run.vm07:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-03-07T01:32:30.400 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-03-07T01:32:30.400 INFO:tasks.ceph.mon.a:Restarting daemon 2026-03-07T01:32:30.400 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-03-07T01:32:30.443 INFO:tasks.ceph.mon.a:Started 2026-03-07T01:32:30.447 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-03-07T01:32:30.447 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-03-07T01:32:30.447 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-03-07T01:32:30.448 INFO:tasks.ceph.mgr.x:Started 2026-03-07T01:32:30.448 INFO:tasks.ceph:Setting crush tunables to default 2026-03-07T01:32:30.448 DEBUG:teuthology.orchestra.run.vm07:> sudo ceph --cluster ceph osd crush tunables default 2026-03-07T01:32:30.972 INFO:teuthology.orchestra.run.vm07.stderr:adjusted tunables profile to default 2026-03-07T01:32:30.987 INFO:tasks.ceph:check_enable_crimson: False 2026-03-07T01:32:30.987 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-03-07T01:32:30.987 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:30.987 DEBUG:teuthology.orchestra.run.vm07:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-03-07T01:32:31.023 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:31.023 DEBUG:teuthology.orchestra.run.vm07:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-03-07T01:32:31.096 DEBUG:teuthology.orchestra.run.vm07:> set -ex 2026-03-07T01:32:31.097 DEBUG:teuthology.orchestra.run.vm07:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-03-07T01:32:31.170 DEBUG:teuthology.orchestra.run.vm07:> sudo ceph --cluster ceph osd new daa44bd6-c2bc-499a-ac45-6b794811e9a3 0 2026-03-07T01:32:31.918 INFO:tasks.ceph.mgr.x.vm07.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-07T01:32:31.918 INFO:tasks.ceph.mgr.x.vm07.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-07T01:32:31.918 INFO:tasks.ceph.mgr.x.vm07.stderr: from numpy import show_config as show_numpy_config 2026-03-07T01:32:31.923 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:31.921+0100 7f5846db7140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-07T01:32:31.971 INFO:teuthology.orchestra.run.vm07.stdout:0 2026-03-07T01:32:31.982 DEBUG:teuthology.orchestra.run.vm07:> sudo ceph --cluster ceph osd new 601f26d9-99b1-479b-8035-4eb34cf754a0 1 2026-03-07T01:32:32.146 INFO:teuthology.orchestra.run.vm07.stdout:1 2026-03-07T01:32:32.171 DEBUG:teuthology.orchestra.run.vm07:> sudo ceph --cluster ceph osd new 33d80069-4964-41fd-8a41-ff59422d0b28 2 2026-03-07T01:32:32.185 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:32.183+0100 7f5846db7140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-07T01:32:32.219 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:32.217+0100 7f5846db7140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-07T01:32:32.253 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:32.250+0100 7f5846db7140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-07T01:32:32.285 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:32.283+0100 7f5846db7140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-07T01:32:32.322 INFO:teuthology.orchestra.run.vm07.stdout:2 2026-03-07T01:32:32.338 INFO:tasks.ceph.osd.0:Restarting daemon 2026-03-07T01:32:32.338 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-03-07T01:32:32.355 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:32.353+0100 7f5846db7140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-07T01:32:32.357 INFO:tasks.ceph.osd.0:Started 2026-03-07T01:32:32.357 INFO:tasks.ceph.osd.1:Restarting daemon 2026-03-07T01:32:32.357 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-03-07T01:32:32.359 INFO:tasks.ceph.osd.1:Started 2026-03-07T01:32:32.359 INFO:tasks.ceph.osd.2:Restarting daemon 2026-03-07T01:32:32.359 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-03-07T01:32:32.362 INFO:tasks.ceph.osd.2:Started 2026-03-07T01:32:32.362 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-03-07T01:32:32.512 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:32.510+0100 7f5846db7140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-07T01:32:32.592 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:32.592 INFO:teuthology.orchestra.run.vm07.stdout:{"epoch":5,"fsid":"d293b3a5-efef-4619-a378-e22bf171f656","created":"2026-03-07T01:32:30.908414+0100","modified":"2026-03-07T01:32:32.302050+0100","last_up_change":"0.000000","last_in_change":"2026-03-07T01:32:32.302050+0100","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"daa44bd6-c2bc-499a-ac45-6b794811e9a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"601f26d9-99b1-479b-8035-4eb34cf754a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"33d80069-4964-41fd-8a41-ff59422d0b28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-07T01:32:32.603 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-03-07T01:32:32.603 INFO:tasks.ceph:Waiting for OSDs to come up 2026-03-07T01:32:32.721 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:32.719+0100 7f5846db7140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-07T01:32:32.785 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:32.782+0100 7f5846db7140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-07T01:32:32.815 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:32.813+0100 7f5846db7140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-07T01:32:32.843 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:32.840+0100 7f5846db7140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-07T01:32:32.874 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:32.871+0100 7f5846db7140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-07T01:32:32.905 DEBUG:teuthology.orchestra.run.vm07:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-03-07T01:32:32.906 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:32.903+0100 7f5846db7140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-07T01:32:33.038 INFO:teuthology.misc.health.vm07.stdout: 2026-03-07T01:32:33.038 INFO:teuthology.misc.health.vm07.stdout:{"epoch":5,"fsid":"d293b3a5-efef-4619-a378-e22bf171f656","created":"2026-03-07T01:32:30.908414+0100","modified":"2026-03-07T01:32:32.302050+0100","last_up_change":"0.000000","last_in_change":"2026-03-07T01:32:32.302050+0100","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"daa44bd6-c2bc-499a-ac45-6b794811e9a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"601f26d9-99b1-479b-8035-4eb34cf754a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"33d80069-4964-41fd-8a41-ff59422d0b28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-07T01:32:33.045 INFO:tasks.ceph.osd.2.vm07.stderr:2026-03-07T01:32:33.042+0100 7f82a0210780 -1 Falling back to public interface 2026-03-07T01:32:33.054 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-03-07T01:32:33.077 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:33.074+0100 7f5846db7140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-07T01:32:33.120 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:33.118+0100 7f5846db7140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-07T01:32:33.291 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:33.289+0100 7f5846db7140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-07T01:32:33.312 INFO:tasks.ceph.osd.0.vm07.stderr:2026-03-07T01:32:33.309+0100 7f436641e780 -1 Falling back to public interface 2026-03-07T01:32:33.324 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:33.322+0100 7f5846db7140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-07T01:32:33.358 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:33.356+0100 7f5846db7140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-07T01:32:33.454 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:33.452+0100 7f5846db7140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-07T01:32:33.485 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:33.482+0100 7f5846db7140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-07T01:32:33.559 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:33.556+0100 7f5846db7140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-07T01:32:33.627 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:33.624+0100 7f5846db7140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-07T01:32:33.726 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:33.723+0100 7f5846db7140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-07T01:32:33.753 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:33.751+0100 7f5846db7140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-07T01:32:33.823 INFO:tasks.ceph.osd.1.vm07.stderr:2026-03-07T01:32:33.819+0100 7fde7422d780 -1 Falling back to public interface 2026-03-07T01:32:33.997 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:33.994+0100 7f5846db7140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-07T01:32:34.137 INFO:tasks.ceph.osd.2.vm07.stderr:2026-03-07T01:32:34.133+0100 7f82a0210780 -1 osd.2 0 log_to_monitors true 2026-03-07T01:32:34.148 INFO:tasks.ceph.osd.0.vm07.stderr:2026-03-07T01:32:34.146+0100 7f436641e780 -1 osd.0 0 log_to_monitors true 2026-03-07T01:32:34.411 INFO:tasks.ceph.osd.1.vm07.stderr:2026-03-07T01:32:34.409+0100 7fde7422d780 -1 osd.1 0 log_to_monitors true 2026-03-07T01:32:35.012 INFO:tasks.ceph.mgr.x.vm07.stderr:2026-03-07T01:32:35.009+0100 7f581441f640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-03-07T01:32:38.780 INFO:tasks.ceph.osd.2.vm07.stderr:2026-03-07T01:32:38.778+0100 7f829ba6d640 -1 osd.2 0 waiting for initial osdmap 2026-03-07T01:32:38.790 INFO:tasks.ceph.osd.0.vm07.stderr:2026-03-07T01:32:38.788+0100 7f43623ab640 -1 osd.0 0 waiting for initial osdmap 2026-03-07T01:32:38.799 INFO:tasks.ceph.osd.2.vm07.stderr:2026-03-07T01:32:38.796+0100 7f8297096640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-07T01:32:38.802 INFO:tasks.ceph.osd.0.vm07.stderr:2026-03-07T01:32:38.800+0100 7f435d9d4640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-07T01:32:38.827 INFO:tasks.ceph.osd.1.vm07.stderr:2026-03-07T01:32:38.825+0100 7fde6ffa0640 -1 osd.1 0 waiting for initial osdmap 2026-03-07T01:32:38.841 INFO:tasks.ceph.osd.1.vm07.stderr:2026-03-07T01:32:38.839+0100 7fde6adb6640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-07T01:32:39.356 DEBUG:teuthology.orchestra.run.vm07:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-03-07T01:32:39.537 INFO:teuthology.misc.health.vm07.stdout: 2026-03-07T01:32:39.537 INFO:teuthology.misc.health.vm07.stdout:{"epoch":7,"fsid":"d293b3a5-efef-4619-a378-e22bf171f656","created":"2026-03-07T01:32:30.908414+0100","modified":"2026-03-07T01:32:36.039032+0100","last_up_change":"0.000000","last_in_change":"2026-03-07T01:32:32.302050+0100","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"daa44bd6-c2bc-499a-ac45-6b794811e9a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"601f26d9-99b1-479b-8035-4eb34cf754a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"33d80069-4964-41fd-8a41-ff59422d0b28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-07T01:32:39.548 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-03-07T01:32:45.850 DEBUG:teuthology.orchestra.run.vm07:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-03-07T01:32:46.025 INFO:teuthology.misc.health.vm07.stdout: 2026-03-07T01:32:46.026 INFO:teuthology.misc.health.vm07.stdout:{"epoch":11,"fsid":"d293b3a5-efef-4619-a378-e22bf171f656","created":"2026-03-07T01:32:30.908414+0100","modified":"2026-03-07T01:32:42.804209+0100","last_up_change":"2026-03-07T01:32:39.790389+0100","last_in_change":"2026-03-07T01:32:32.302050+0100","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-07T01:32:40.027844+0100","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"daa44bd6-c2bc-499a-ac45-6b794811e9a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6808","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6809","nonce":2333053155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6810","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6811","nonce":2333053155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6814","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6815","nonce":2333053155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6812","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6813","nonce":2333053155}]},"public_addr":"192.168.123.107:6809/2333053155","cluster_addr":"192.168.123.107:6811/2333053155","heartbeat_back_addr":"192.168.123.107:6815/2333053155","heartbeat_front_addr":"192.168.123.107:6813/2333053155","state":["exists","up"]},{"osd":1,"uuid":"601f26d9-99b1-479b-8035-4eb34cf754a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6816","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6817","nonce":184725705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6818","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6819","nonce":184725705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6822","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6823","nonce":184725705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6820","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6821","nonce":184725705}]},"public_addr":"192.168.123.107:6817/184725705","cluster_addr":"192.168.123.107:6819/184725705","heartbeat_back_addr":"192.168.123.107:6823/184725705","heartbeat_front_addr":"192.168.123.107:6821/184725705","state":["exists","up"]},{"osd":2,"uuid":"33d80069-4964-41fd-8a41-ff59422d0b28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6800","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6801","nonce":967594618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6802","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6803","nonce":967594618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6806","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6807","nonce":967594618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6804","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6805","nonce":967594618}]},"public_addr":"192.168.123.107:6801/967594618","cluster_addr":"192.168.123.107:6803/967594618","heartbeat_back_addr":"192.168.123.107:6807/967594618","heartbeat_front_addr":"192.168.123.107:6805/967594618","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-07T01:32:46.037 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-03-07T01:32:46.037 INFO:tasks.ceph:Creating RBD pool 2026-03-07T01:32:46.037 DEBUG:teuthology.orchestra.run.vm07:> sudo ceph --cluster ceph osd pool create rbd 8 2026-03-07T01:32:46.823 INFO:teuthology.orchestra.run.vm07.stderr:pool 'rbd' created 2026-03-07T01:32:46.841 DEBUG:teuthology.orchestra.run.vm07:> rbd --cluster ceph pool init rbd 2026-03-07T01:32:46.878 INFO:teuthology.orchestra.run.vm07.stderr:ignoring --setuser ceph since I am not root 2026-03-07T01:32:46.878 INFO:teuthology.orchestra.run.vm07.stderr:ignoring --setgroup ceph since I am not root 2026-03-07T01:32:49.845 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-03-07T01:32:49.846 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-03-07T01:32:49.846 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-03-07T01:32:49.846 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-03-07T01:32:49.846 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-03-07T01:32:50.113 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:50.126 INFO:teuthology.orchestra.run.vm07.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6824","nonce":185168877},{"type":"v1","addr":"192.168.123.107:6825","nonce":185168877}]},"active_addr":"192.168.123.107:6825/185168877","active_change":"2026-03-07T01:32:33.997045+0100","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"192.168.123.107:0","nonce":3478846702}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"192.168.123.107:0","nonce":1242458581}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"192.168.123.107:0","nonce":1819601133}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"192.168.123.107:0","nonce":2609760338}]}]} 2026-03-07T01:32:50.127 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-03-07T01:32:50.127 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-03-07T01:32:50.127 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-03-07T01:32:50.316 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:50.316 INFO:teuthology.orchestra.run.vm07.stdout:{"epoch":15,"fsid":"d293b3a5-efef-4619-a378-e22bf171f656","created":"2026-03-07T01:32:30.908414+0100","modified":"2026-03-07T01:32:49.831363+0100","last_up_change":"2026-03-07T01:32:39.790389+0100","last_in_change":"2026-03-07T01:32:32.302050+0100","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-07T01:32:40.027844+0100","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-03-07T01:32:46.227445+0100","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"daa44bd6-c2bc-499a-ac45-6b794811e9a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6808","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6809","nonce":2333053155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6810","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6811","nonce":2333053155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6814","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6815","nonce":2333053155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6812","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6813","nonce":2333053155}]},"public_addr":"192.168.123.107:6809/2333053155","cluster_addr":"192.168.123.107:6811/2333053155","heartbeat_back_addr":"192.168.123.107:6815/2333053155","heartbeat_front_addr":"192.168.123.107:6813/2333053155","state":["exists","up"]},{"osd":1,"uuid":"601f26d9-99b1-479b-8035-4eb34cf754a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6816","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6817","nonce":184725705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6818","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6819","nonce":184725705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6822","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6823","nonce":184725705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6820","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6821","nonce":184725705}]},"public_addr":"192.168.123.107:6817/184725705","cluster_addr":"192.168.123.107:6819/184725705","heartbeat_back_addr":"192.168.123.107:6823/184725705","heartbeat_front_addr":"192.168.123.107:6821/184725705","state":["exists","up"]},{"osd":2,"uuid":"33d80069-4964-41fd-8a41-ff59422d0b28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6800","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6801","nonce":967594618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6802","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6803","nonce":967594618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6806","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6807","nonce":967594618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6804","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6805","nonce":967594618}]},"public_addr":"192.168.123.107:6801/967594618","cluster_addr":"192.168.123.107:6803/967594618","heartbeat_back_addr":"192.168.123.107:6807/967594618","heartbeat_front_addr":"192.168.123.107:6805/967594618","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-07T01:32:50.327 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-03-07T01:32:50.328 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-03-07T01:32:50.512 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:50.512 INFO:teuthology.orchestra.run.vm07.stdout:{"epoch":15,"fsid":"d293b3a5-efef-4619-a378-e22bf171f656","created":"2026-03-07T01:32:30.908414+0100","modified":"2026-03-07T01:32:49.831363+0100","last_up_change":"2026-03-07T01:32:39.790389+0100","last_in_change":"2026-03-07T01:32:32.302050+0100","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-07T01:32:40.027844+0100","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-03-07T01:32:46.227445+0100","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"daa44bd6-c2bc-499a-ac45-6b794811e9a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6808","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6809","nonce":2333053155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6810","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6811","nonce":2333053155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6814","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6815","nonce":2333053155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6812","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6813","nonce":2333053155}]},"public_addr":"192.168.123.107:6809/2333053155","cluster_addr":"192.168.123.107:6811/2333053155","heartbeat_back_addr":"192.168.123.107:6815/2333053155","heartbeat_front_addr":"192.168.123.107:6813/2333053155","state":["exists","up"]},{"osd":1,"uuid":"601f26d9-99b1-479b-8035-4eb34cf754a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6816","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6817","nonce":184725705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6818","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6819","nonce":184725705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6822","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6823","nonce":184725705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6820","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6821","nonce":184725705}]},"public_addr":"192.168.123.107:6817/184725705","cluster_addr":"192.168.123.107:6819/184725705","heartbeat_back_addr":"192.168.123.107:6823/184725705","heartbeat_front_addr":"192.168.123.107:6821/184725705","state":["exists","up"]},{"osd":2,"uuid":"33d80069-4964-41fd-8a41-ff59422d0b28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6800","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6801","nonce":967594618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6802","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6803","nonce":967594618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6806","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6807","nonce":967594618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6804","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6805","nonce":967594618}]},"public_addr":"192.168.123.107:6801/967594618","cluster_addr":"192.168.123.107:6803/967594618","heartbeat_back_addr":"192.168.123.107:6807/967594618","heartbeat_front_addr":"192.168.123.107:6805/967594618","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-07T01:32:50.524 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-03-07T01:32:50.524 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-03-07T01:32:50.524 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-03-07T01:32:50.639 INFO:teuthology.orchestra.run.vm07.stdout:34359738372 2026-03-07T01:32:50.640 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-03-07T01:32:50.689 INFO:teuthology.orchestra.run.vm07.stdout:34359738372 2026-03-07T01:32:50.689 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-03-07T01:32:50.720 INFO:teuthology.orchestra.run.vm07.stdout:34359738372 2026-03-07T01:32:50.720 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-03-07T01:32:50.920 INFO:teuthology.orchestra.run.vm07.stdout:34359738370 2026-03-07T01:32:50.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738370 for osd.0 2026-03-07T01:32:50.985 INFO:teuthology.orchestra.run.vm07.stdout:34359738370 2026-03-07T01:32:51.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738370 for osd.1 2026-03-07T01:32:51.004 INFO:teuthology.orchestra.run.vm07.stdout:34359738370 2026-03-07T01:32:51.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738370 for osd.2 2026-03-07T01:32:51.948 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-03-07T01:32:52.003 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-03-07T01:32:52.018 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-03-07T01:32:52.193 INFO:teuthology.orchestra.run.vm07.stdout:34359738370 2026-03-07T01:32:52.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738370 for osd.0 2026-03-07T01:32:52.238 INFO:teuthology.orchestra.run.vm07.stdout:34359738370 2026-03-07T01:32:52.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738370 for osd.1 2026-03-07T01:32:52.322 INFO:teuthology.orchestra.run.vm07.stdout:34359738370 2026-03-07T01:32:52.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738370 for osd.2 2026-03-07T01:32:53.213 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-03-07T01:32:53.250 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-03-07T01:32:53.335 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-03-07T01:32:53.509 INFO:teuthology.orchestra.run.vm07.stdout:34359738372 2026-03-07T01:32:53.511 INFO:teuthology.orchestra.run.vm07.stdout:34359738372 2026-03-07T01:32:53.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.0 2026-03-07T01:32:53.527 DEBUG:teuthology.parallel:result is None 2026-03-07T01:32:53.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.1 2026-03-07T01:32:53.530 DEBUG:teuthology.parallel:result is None 2026-03-07T01:32:53.534 INFO:teuthology.orchestra.run.vm07.stdout:34359738372 2026-03-07T01:32:53.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.2 2026-03-07T01:32:53.545 DEBUG:teuthology.parallel:result is None 2026-03-07T01:32:53.545 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-03-07T01:32:53.545 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-03-07T01:32:53.772 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:53.772 INFO:teuthology.orchestra.run.vm07.stderr:dumped all 2026-03-07T01:32:53.786 INFO:teuthology.orchestra.run.vm07.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2026-03-07T01:32:52.005418+0100","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81804,"kb_used_data":1280,"kb_used_omap":4,"kb_used_meta":80443,"kb_avail":314490996,"statfs":{"total":322122547200,"available":322038779904,"internally_reserved":0,"allocated":1310720,"data_stored":1026013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4788,"internal_metadata":82373964},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.183895"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:49.842673+0100","last_change":"2026-03-07T01:32:49.842673+0100","last_active":"2026-03-07T01:32:49.842673+0100","last_peered":"2026-03-07T01:32:49.842673+0100","last_clean":"2026-03-07T01:32:49.842673+0100","last_became_active":"2026-03-07T01:32:47.833028+0100","last_became_peered":"2026-03-07T01:32:47.833028+0100","last_unstale":"2026-03-07T01:32:49.842673+0100","last_undegraded":"2026-03-07T01:32:49.842673+0100","last_fullsized":"2026-03-07T01:32:49.842673+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T06:46:34.331258+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027108699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:49.845320+0100","last_change":"2026-03-07T01:32:49.845320+0100","last_active":"2026-03-07T01:32:49.845320+0100","last_peered":"2026-03-07T01:32:49.845320+0100","last_clean":"2026-03-07T01:32:49.845320+0100","last_became_active":"2026-03-07T01:32:47.833125+0100","last_became_peered":"2026-03-07T01:32:47.833125+0100","last_unstale":"2026-03-07T01:32:49.845320+0100","last_undegraded":"2026-03-07T01:32:49.845320+0100","last_fullsized":"2026-03-07T01:32:49.845320+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T04:29:36.888078+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039410900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:49.845222+0100","last_change":"2026-03-07T01:32:49.845222+0100","last_active":"2026-03-07T01:32:49.845222+0100","last_peered":"2026-03-07T01:32:49.845222+0100","last_clean":"2026-03-07T01:32:49.845222+0100","last_became_active":"2026-03-07T01:32:47.833210+0100","last_became_peered":"2026-03-07T01:32:47.833210+0100","last_unstale":"2026-03-07T01:32:49.845222+0100","last_undegraded":"2026-03-07T01:32:49.845222+0100","last_fullsized":"2026-03-07T01:32:49.845222+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T08:00:17.280495+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036142800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:49.842708+0100","last_change":"2026-03-07T01:32:49.842708+0100","last_active":"2026-03-07T01:32:49.842708+0100","last_peered":"2026-03-07T01:32:49.842708+0100","last_clean":"2026-03-07T01:32:49.842708+0100","last_became_active":"2026-03-07T01:32:47.833276+0100","last_became_peered":"2026-03-07T01:32:47.833276+0100","last_unstale":"2026-03-07T01:32:49.842708+0100","last_undegraded":"2026-03-07T01:32:49.842708+0100","last_fullsized":"2026-03-07T01:32:49.842708+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T09:30:23.161677+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021422100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:49.840308+0100","last_change":"2026-03-07T01:32:49.837905+0100","last_active":"2026-03-07T01:32:49.840308+0100","last_peered":"2026-03-07T01:32:49.840308+0100","last_clean":"2026-03-07T01:32:49.840308+0100","last_became_active":"2026-03-07T01:32:47.837875+0100","last_became_peered":"2026-03-07T01:32:47.837875+0100","last_unstale":"2026-03-07T01:32:49.840308+0100","last_undegraded":"2026-03-07T01:32:49.840308+0100","last_fullsized":"2026-03-07T01:32:49.840308+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:43:52.534537+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000191418,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:50.097472+0100","last_change":"2026-03-07T01:32:50.097629+0100","last_active":"2026-03-07T01:32:50.097472+0100","last_peered":"2026-03-07T01:32:50.097472+0100","last_clean":"2026-03-07T01:32:50.097472+0100","last_became_active":"2026-03-07T01:32:47.839227+0100","last_became_peered":"2026-03-07T01:32:47.839227+0100","last_unstale":"2026-03-07T01:32:50.097472+0100","last_undegraded":"2026-03-07T01:32:50.097472+0100","last_fullsized":"2026-03-07T01:32:50.097472+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:43:52.534537+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038883800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:50.097718+0100","last_change":"2026-03-07T01:32:50.097804+0100","last_active":"2026-03-07T01:32:50.097718+0100","last_peered":"2026-03-07T01:32:50.097718+0100","last_clean":"2026-03-07T01:32:50.097718+0100","last_became_active":"2026-03-07T01:32:47.838194+0100","last_became_peered":"2026-03-07T01:32:47.838194+0100","last_unstale":"2026-03-07T01:32:50.097718+0100","last_undegraded":"2026-03-07T01:32:50.097718+0100","last_fullsized":"2026-03-07T01:32:50.097718+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T10:41:58.144437+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000262742,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:49.842796+0100","last_change":"2026-03-07T01:32:49.842796+0100","last_active":"2026-03-07T01:32:49.842796+0100","last_peered":"2026-03-07T01:32:49.842796+0100","last_clean":"2026-03-07T01:32:49.842796+0100","last_became_active":"2026-03-07T01:32:47.833341+0100","last_became_peered":"2026-03-07T01:32:47.833341+0100","last_unstale":"2026-03-07T01:32:49.842796+0100","last_undegraded":"2026-03-07T01:32:49.842796+0100","last_fullsized":"2026-03-07T01:32:49.842796+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T03:13:46.022033+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024972699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"10'32","reported_seq":64,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:49.842578+0100","last_change":"2026-03-07T01:32:41.806893+0100","last_active":"2026-03-07T01:32:49.842578+0100","last_peered":"2026-03-07T01:32:49.842578+0100","last_clean":"2026-03-07T01:32:49.842578+0100","last_became_active":"2026-03-07T01:32:41.806810+0100","last_became_peered":"2026-03-07T01:32:41.806810+0100","last_unstale":"2026-03-07T01:32:49.842578+0100","last_undegraded":"2026-03-07T01:32:49.842578+0100","last_fullsized":"2026-03-07T01:32:49.842578+0100","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:40.792540+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:40.792540+0100","last_clean_scrub_stamp":"2026-03-07T01:32:40.792540+0100","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T11:29:56.806508+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":26956,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830644,"statfs":{"total":107374182400,"available":107346579456,"internally_reserved":0,"allocated":114688,"data_stored":31125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27424,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830176,"statfs":{"total":107374182400,"available":107346100224,"internally_reserved":0,"allocated":598016,"data_stored":497444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27424,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830176,"statfs":{"total":107374182400,"available":107346100224,"internally_reserved":0,"allocated":598016,"data_stored":497444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-07T01:32:53.787 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-03-07T01:32:53.966 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:53.966 INFO:teuthology.orchestra.run.vm07.stderr:dumped all 2026-03-07T01:32:53.977 INFO:teuthology.orchestra.run.vm07.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2026-03-07T01:32:52.005418+0100","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81804,"kb_used_data":1280,"kb_used_omap":4,"kb_used_meta":80443,"kb_avail":314490996,"statfs":{"total":322122547200,"available":322038779904,"internally_reserved":0,"allocated":1310720,"data_stored":1026013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4788,"internal_metadata":82373964},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.183895"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:49.842673+0100","last_change":"2026-03-07T01:32:49.842673+0100","last_active":"2026-03-07T01:32:49.842673+0100","last_peered":"2026-03-07T01:32:49.842673+0100","last_clean":"2026-03-07T01:32:49.842673+0100","last_became_active":"2026-03-07T01:32:47.833028+0100","last_became_peered":"2026-03-07T01:32:47.833028+0100","last_unstale":"2026-03-07T01:32:49.842673+0100","last_undegraded":"2026-03-07T01:32:49.842673+0100","last_fullsized":"2026-03-07T01:32:49.842673+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T06:46:34.331258+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027108699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:49.845320+0100","last_change":"2026-03-07T01:32:49.845320+0100","last_active":"2026-03-07T01:32:49.845320+0100","last_peered":"2026-03-07T01:32:49.845320+0100","last_clean":"2026-03-07T01:32:49.845320+0100","last_became_active":"2026-03-07T01:32:47.833125+0100","last_became_peered":"2026-03-07T01:32:47.833125+0100","last_unstale":"2026-03-07T01:32:49.845320+0100","last_undegraded":"2026-03-07T01:32:49.845320+0100","last_fullsized":"2026-03-07T01:32:49.845320+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T04:29:36.888078+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039410900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:49.845222+0100","last_change":"2026-03-07T01:32:49.845222+0100","last_active":"2026-03-07T01:32:49.845222+0100","last_peered":"2026-03-07T01:32:49.845222+0100","last_clean":"2026-03-07T01:32:49.845222+0100","last_became_active":"2026-03-07T01:32:47.833210+0100","last_became_peered":"2026-03-07T01:32:47.833210+0100","last_unstale":"2026-03-07T01:32:49.845222+0100","last_undegraded":"2026-03-07T01:32:49.845222+0100","last_fullsized":"2026-03-07T01:32:49.845222+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T08:00:17.280495+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036142800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:49.842708+0100","last_change":"2026-03-07T01:32:49.842708+0100","last_active":"2026-03-07T01:32:49.842708+0100","last_peered":"2026-03-07T01:32:49.842708+0100","last_clean":"2026-03-07T01:32:49.842708+0100","last_became_active":"2026-03-07T01:32:47.833276+0100","last_became_peered":"2026-03-07T01:32:47.833276+0100","last_unstale":"2026-03-07T01:32:49.842708+0100","last_undegraded":"2026-03-07T01:32:49.842708+0100","last_fullsized":"2026-03-07T01:32:49.842708+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T09:30:23.161677+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021422100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:49.840308+0100","last_change":"2026-03-07T01:32:49.837905+0100","last_active":"2026-03-07T01:32:49.840308+0100","last_peered":"2026-03-07T01:32:49.840308+0100","last_clean":"2026-03-07T01:32:49.840308+0100","last_became_active":"2026-03-07T01:32:47.837875+0100","last_became_peered":"2026-03-07T01:32:47.837875+0100","last_unstale":"2026-03-07T01:32:49.840308+0100","last_undegraded":"2026-03-07T01:32:49.840308+0100","last_fullsized":"2026-03-07T01:32:49.840308+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:43:52.534537+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000191418,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:50.097472+0100","last_change":"2026-03-07T01:32:50.097629+0100","last_active":"2026-03-07T01:32:50.097472+0100","last_peered":"2026-03-07T01:32:50.097472+0100","last_clean":"2026-03-07T01:32:50.097472+0100","last_became_active":"2026-03-07T01:32:47.839227+0100","last_became_peered":"2026-03-07T01:32:47.839227+0100","last_unstale":"2026-03-07T01:32:50.097472+0100","last_undegraded":"2026-03-07T01:32:50.097472+0100","last_fullsized":"2026-03-07T01:32:50.097472+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:43:52.534537+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038883800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:50.097718+0100","last_change":"2026-03-07T01:32:50.097804+0100","last_active":"2026-03-07T01:32:50.097718+0100","last_peered":"2026-03-07T01:32:50.097718+0100","last_clean":"2026-03-07T01:32:50.097718+0100","last_became_active":"2026-03-07T01:32:47.838194+0100","last_became_peered":"2026-03-07T01:32:47.838194+0100","last_unstale":"2026-03-07T01:32:50.097718+0100","last_undegraded":"2026-03-07T01:32:50.097718+0100","last_fullsized":"2026-03-07T01:32:50.097718+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T10:41:58.144437+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000262742,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:49.842796+0100","last_change":"2026-03-07T01:32:49.842796+0100","last_active":"2026-03-07T01:32:49.842796+0100","last_peered":"2026-03-07T01:32:49.842796+0100","last_clean":"2026-03-07T01:32:49.842796+0100","last_became_active":"2026-03-07T01:32:47.833341+0100","last_became_peered":"2026-03-07T01:32:47.833341+0100","last_unstale":"2026-03-07T01:32:49.842796+0100","last_undegraded":"2026-03-07T01:32:49.842796+0100","last_fullsized":"2026-03-07T01:32:49.842796+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T03:13:46.022033+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024972699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"10'32","reported_seq":64,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-03-07T01:32:49.842578+0100","last_change":"2026-03-07T01:32:41.806893+0100","last_active":"2026-03-07T01:32:49.842578+0100","last_peered":"2026-03-07T01:32:49.842578+0100","last_clean":"2026-03-07T01:32:49.842578+0100","last_became_active":"2026-03-07T01:32:41.806810+0100","last_became_peered":"2026-03-07T01:32:41.806810+0100","last_unstale":"2026-03-07T01:32:49.842578+0100","last_undegraded":"2026-03-07T01:32:49.842578+0100","last_fullsized":"2026-03-07T01:32:49.842578+0100","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:40.792540+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:40.792540+0100","last_clean_scrub_stamp":"2026-03-07T01:32:40.792540+0100","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T11:29:56.806508+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":26956,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830644,"statfs":{"total":107374182400,"available":107346579456,"internally_reserved":0,"allocated":114688,"data_stored":31125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27424,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830176,"statfs":{"total":107374182400,"available":107346100224,"internally_reserved":0,"allocated":598016,"data_stored":497444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27424,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830176,"statfs":{"total":107374182400,"available":107346100224,"internally_reserved":0,"allocated":598016,"data_stored":497444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-07T01:32:53.978 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-03-07T01:32:53.978 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-03-07T01:32:53.978 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-03-07T01:32:53.978 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-03-07T01:32:54.173 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:32:54.173 INFO:teuthology.orchestra.run.vm07.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-03-07T01:32:54.185 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-03-07T01:32:54.186 INFO:teuthology.run_tasks:Running task tox... 2026-03-07T01:32:54.188 INFO:tasks.tox:Deploying tox from pip... 2026-03-07T01:32:54.188 DEBUG:teuthology.orchestra.run.vm07:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2026-03-07T01:32:55.516 DEBUG:teuthology.orchestra.run.vm07:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2026-03-07T01:32:55.826 INFO:teuthology.orchestra.run.vm07.stdout:Collecting tox==3.15.0 2026-03-07T01:32:55.856 INFO:teuthology.orchestra.run.vm07.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2026-03-07T01:32:55.907 INFO:teuthology.orchestra.run.vm07.stdout:Collecting packaging>=14 2026-03-07T01:32:55.915 INFO:teuthology.orchestra.run.vm07.stdout: Downloading packaging-26.0-py3-none-any.whl (74 kB) 2026-03-07T01:32:56.053 INFO:teuthology.orchestra.run.vm07.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2026-03-07T01:32:56.062 INFO:teuthology.orchestra.run.vm07.stdout: Downloading virtualenv-21.1.0-py3-none-any.whl (5.8 MB) 2026-03-07T01:32:56.191 INFO:teuthology.orchestra.run.vm07.stdout:Collecting filelock<4,>=3.0.0 2026-03-07T01:32:56.199 INFO:teuthology.orchestra.run.vm07.stdout: Downloading filelock-3.19.1-py3-none-any.whl (15 kB) 2026-03-07T01:32:56.226 INFO:teuthology.orchestra.run.vm07.stdout:Collecting py<2,>=1.4.17 2026-03-07T01:32:56.234 INFO:teuthology.orchestra.run.vm07.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2026-03-07T01:32:56.259 INFO:teuthology.orchestra.run.vm07.stdout:Collecting pluggy<1,>=0.12.0 2026-03-07T01:32:56.270 INFO:teuthology.orchestra.run.vm07.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2026-03-07T01:32:56.290 INFO:teuthology.orchestra.run.vm07.stdout:Collecting six<2,>=1.14.0 2026-03-07T01:32:56.298 INFO:teuthology.orchestra.run.vm07.stdout: Downloading six-1.17.0-py2.py3-none-any.whl (11 kB) 2026-03-07T01:32:56.316 INFO:teuthology.orchestra.run.vm07.stdout:Collecting toml>=0.9.4 2026-03-07T01:32:56.325 INFO:teuthology.orchestra.run.vm07.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2026-03-07T01:32:56.369 INFO:teuthology.orchestra.run.vm07.stdout:Collecting platformdirs<5,>=3.9.1 2026-03-07T01:32:56.377 INFO:teuthology.orchestra.run.vm07.stdout: Downloading platformdirs-4.4.0-py3-none-any.whl (18 kB) 2026-03-07T01:32:56.396 INFO:teuthology.orchestra.run.vm07.stdout:Collecting python-discovery>=1 2026-03-07T01:32:56.405 INFO:teuthology.orchestra.run.vm07.stdout: Downloading python_discovery-1.1.1-py3-none-any.whl (30 kB) 2026-03-07T01:32:56.428 INFO:teuthology.orchestra.run.vm07.stdout:Collecting distlib<1,>=0.3.7 2026-03-07T01:32:56.437 INFO:teuthology.orchestra.run.vm07.stdout: Downloading distlib-0.4.0-py2.py3-none-any.whl (469 kB) 2026-03-07T01:32:56.473 INFO:teuthology.orchestra.run.vm07.stdout:Collecting typing-extensions>=4.13.2 2026-03-07T01:32:56.481 INFO:teuthology.orchestra.run.vm07.stdout: Downloading typing_extensions-4.15.0-py3-none-any.whl (44 kB) 2026-03-07T01:32:56.536 INFO:teuthology.orchestra.run.vm07.stdout:Installing collected packages: platformdirs, filelock, typing-extensions, python-discovery, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2026-03-07T01:32:56.889 INFO:teuthology.orchestra.run.vm07.stdout:Successfully installed distlib-0.4.0 filelock-3.19.1 packaging-26.0 platformdirs-4.4.0 pluggy-0.13.1 py-1.11.0 python-discovery-1.1.1 six-1.17.0 toml-0.10.2 tox-3.15.0 typing-extensions-4.15.0 virtualenv-21.1.0 2026-03-07T01:32:56.982 INFO:teuthology.orchestra.run.vm07.stderr:WARNING: You are using pip version 21.3.1; however, version 26.0.1 is available. 2026-03-07T01:32:56.982 INFO:teuthology.orchestra.run.vm07.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2026-03-07T01:32:57.042 INFO:teuthology.run_tasks:Running task keystone... 2026-03-07T01:32:57.045 DEBUG:tasks.keystone:Keystone config is {'client.0': {'force-branch': 'stable/2025.1', 'services': [{'description': 'Swift Service', 'name': 'swift', 'type': 'object-store'}], 'ec2 credentials': [{'project': 's3tests', 'user': 's3tests-main'}], 'projects': [{'description': 's3tests project', 'name': 's3tests'}], 'role-mappings': [{'name': 'member', 'project': 's3tests', 'user': 's3tests-main'}], 'roles': [{'name': 'member'}], 'users': [{'name': 's3tests-main', 'password': 'SECRET', 'project': 's3tests'}]}} 2026-03-07T01:32:57.045 INFO:tasks.keystone:Downloading keystone... 2026-03-07T01:32:57.045 DEBUG:teuthology.orchestra.run.vm07:> git clone -b stable/2025.1 https://github.com/openstack/keystone.git /home/ubuntu/cephtest/keystone 2026-03-07T01:32:57.064 INFO:teuthology.orchestra.run.vm07.stderr:Cloning into '/home/ubuntu/cephtest/keystone'... 2026-03-07T01:33:01.020 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && sed -i 's/pysaml2<4.0.3,>=2.4.0/pysaml2>=4.5.0/' requirements.txt 2026-03-07T01:33:01.076 INFO:tasks.keystone:Installing packages for Keystone... 2026-03-07T01:33:01.077 DEBUG:teuthology.orchestra.run.vm07:> source /home/ubuntu/cephtest/tox-venv/bin/activate && python 2026-03-07T01:33:01.160 INFO:teuthology.orchestra.run.vm07.stderr:No fix necessary 2026-03-07T01:33:01.162 DEBUG:teuthology.orchestra.run.vm07:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install bindep 2026-03-07T01:33:01.414 INFO:teuthology.orchestra.run.vm07.stdout:Collecting bindep 2026-03-07T01:33:01.445 INFO:teuthology.orchestra.run.vm07.stdout: Downloading bindep-2.13.0-py3-none-any.whl (34 kB) 2026-03-07T01:33:01.500 INFO:teuthology.orchestra.run.vm07.stdout:Collecting pbr>=2 2026-03-07T01:33:01.509 INFO:teuthology.orchestra.run.vm07.stdout: Downloading pbr-7.0.3-py2.py3-none-any.whl (131 kB) 2026-03-07T01:33:01.542 INFO:teuthology.orchestra.run.vm07.stdout:Collecting distro>=1.7 2026-03-07T01:33:01.550 INFO:teuthology.orchestra.run.vm07.stdout: Downloading distro-1.9.0-py3-none-any.whl (20 kB) 2026-03-07T01:33:01.552 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: packaging in ./cephtest/tox-venv/lib/python3.9/site-packages (from bindep) (26.0) 2026-03-07T01:33:01.566 INFO:teuthology.orchestra.run.vm07.stdout:Collecting Parsley 2026-03-07T01:33:01.574 INFO:teuthology.orchestra.run.vm07.stdout: Downloading Parsley-1.3-py2.py3-none-any.whl (88 kB) 2026-03-07T01:33:01.579 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: setuptools in ./cephtest/tox-venv/lib/python3.9/site-packages (from pbr>=2->bindep) (53.0.0) 2026-03-07T01:33:01.613 INFO:teuthology.orchestra.run.vm07.stdout:Installing collected packages: pbr, Parsley, distro, bindep 2026-03-07T01:33:01.727 INFO:teuthology.orchestra.run.vm07.stdout:Successfully installed Parsley-1.3 bindep-2.13.0 distro-1.9.0 pbr-7.0.3 2026-03-07T01:33:01.728 INFO:teuthology.orchestra.run.vm07.stderr:WARNING: You are using pip version 21.3.1; however, version 26.0.1 is available. 2026-03-07T01:33:01.728 INFO:teuthology.orchestra.run.vm07.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2026-03-07T01:33:01.774 DEBUG:teuthology.orchestra.run.vm07:> source /home/ubuntu/cephtest/tox-venv/bin/activate && bindep --brief --file /home/ubuntu/cephtest/keystone/bindep.txt 2026-03-07T01:33:02.405 INFO:teuthology.orchestra.run.vm07.stdout:cyrus-sasl-devel 2026-03-07T01:33:02.405 INFO:teuthology.orchestra.run.vm07.stdout:libffi-devel 2026-03-07T01:33:02.405 INFO:teuthology.orchestra.run.vm07.stdout:libxml2-devel 2026-03-07T01:33:02.405 INFO:teuthology.orchestra.run.vm07.stdout:libxslt-devel 2026-03-07T01:33:02.405 INFO:teuthology.orchestra.run.vm07.stdout:mariadb 2026-03-07T01:33:02.405 INFO:teuthology.orchestra.run.vm07.stdout:mariadb-devel 2026-03-07T01:33:02.405 INFO:teuthology.orchestra.run.vm07.stdout:mariadb-server 2026-03-07T01:33:02.405 INFO:teuthology.orchestra.run.vm07.stdout:openldap-devel 2026-03-07T01:33:02.405 INFO:teuthology.orchestra.run.vm07.stdout:openssl-devel 2026-03-07T01:33:02.405 INFO:teuthology.orchestra.run.vm07.stdout:postgresql 2026-03-07T01:33:02.405 INFO:teuthology.orchestra.run.vm07.stdout:postgresql-devel 2026-03-07T01:33:02.405 INFO:teuthology.orchestra.run.vm07.stdout:postgresql-server 2026-03-07T01:33:02.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-07T01:33:02.422 INFO:teuthology.packaging:Installing package cyrus-sasl-devel on ubuntu@vm07.local 2026-03-07T01:33:02.422 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y install cyrus-sasl-devel 2026-03-07T01:33:02.820 INFO:teuthology.orchestra.run.vm07.stdout:Last metadata expiration check: 0:01:23 ago on Sat 07 Mar 2026 01:31:39 AM CET. 2026-03-07T01:33:02.896 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:33:02.896 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:02.896 INFO:teuthology.orchestra.run.vm07.stdout: Package Architecture Version Repository Size 2026-03-07T01:33:02.896 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:02.896 INFO:teuthology.orchestra.run.vm07.stdout:Installing: 2026-03-07T01:33:02.896 INFO:teuthology.orchestra.run.vm07.stdout: cyrus-sasl-devel x86_64 2.1.27-21.el9 appstream 102 k 2026-03-07T01:33:02.896 INFO:teuthology.orchestra.run.vm07.stdout:Installing dependencies: 2026-03-07T01:33:02.896 INFO:teuthology.orchestra.run.vm07.stdout: cyrus-sasl x86_64 2.1.27-21.el9 baseos 71 k 2026-03-07T01:33:02.896 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:02.896 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:33:02.896 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:02.896 INFO:teuthology.orchestra.run.vm07.stdout:Install 2 Packages 2026-03-07T01:33:02.896 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:02.897 INFO:teuthology.orchestra.run.vm07.stdout:Total download size: 173 k 2026-03-07T01:33:02.897 INFO:teuthology.orchestra.run.vm07.stdout:Installed size: 349 k 2026-03-07T01:33:02.897 INFO:teuthology.orchestra.run.vm07.stdout:Downloading Packages: 2026-03-07T01:33:03.723 INFO:teuthology.orchestra.run.vm07.stdout:(1/2): cyrus-sasl-devel-2.1.27-21.el9.x86_64.rp 194 kB/s | 102 kB 00:00 2026-03-07T01:33:03.935 INFO:teuthology.orchestra.run.vm07.stdout:(2/2): cyrus-sasl-2.1.27-21.el9.x86_64.rpm 96 kB/s | 71 kB 00:00 2026-03-07T01:33:03.936 INFO:teuthology.orchestra.run.vm07.stdout:-------------------------------------------------------------------------------- 2026-03-07T01:33:03.936 INFO:teuthology.orchestra.run.vm07.stdout:Total 166 kB/s | 173 kB 00:01 2026-03-07T01:33:03.951 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:33:03.958 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:33:03.958 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:33:03.982 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:33:03.983 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:33:04.246 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:33:04.378 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: cyrus-sasl-2.1.27-21.el9.x86_64 1/2 2026-03-07T01:33:04.381 INFO:teuthology.orchestra.run.vm07.stdout: Installing : cyrus-sasl-2.1.27-21.el9.x86_64 1/2 2026-03-07T01:33:04.413 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: cyrus-sasl-2.1.27-21.el9.x86_64 1/2 2026-03-07T01:33:04.433 INFO:teuthology.orchestra.run.vm07.stdout: Installing : cyrus-sasl-devel-2.1.27-21.el9.x86_64 2/2 2026-03-07T01:33:04.876 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: cyrus-sasl-devel-2.1.27-21.el9.x86_64 2/2 2026-03-07T01:33:04.876 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : cyrus-sasl-2.1.27-21.el9.x86_64 1/2 2026-03-07T01:33:04.931 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : cyrus-sasl-devel-2.1.27-21.el9.x86_64 2/2 2026-03-07T01:33:04.931 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:04.931 INFO:teuthology.orchestra.run.vm07.stdout:Installed: 2026-03-07T01:33:04.931 INFO:teuthology.orchestra.run.vm07.stdout: cyrus-sasl-2.1.27-21.el9.x86_64 cyrus-sasl-devel-2.1.27-21.el9.x86_64 2026-03-07T01:33:04.931 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:04.931 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:33:04.969 INFO:teuthology.packaging:Installing package libffi-devel on ubuntu@vm07.local 2026-03-07T01:33:04.969 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y install libffi-devel 2026-03-07T01:33:05.383 INFO:teuthology.orchestra.run.vm07.stdout:Last metadata expiration check: 0:01:26 ago on Sat 07 Mar 2026 01:31:39 AM CET. 2026-03-07T01:33:05.453 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:33:05.454 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:05.454 INFO:teuthology.orchestra.run.vm07.stdout: Package Architecture Version Repository Size 2026-03-07T01:33:05.454 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:05.454 INFO:teuthology.orchestra.run.vm07.stdout:Installing: 2026-03-07T01:33:05.454 INFO:teuthology.orchestra.run.vm07.stdout: libffi-devel x86_64 3.4.2-8.el9 appstream 28 k 2026-03-07T01:33:05.454 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:05.454 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:33:05.454 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:05.454 INFO:teuthology.orchestra.run.vm07.stdout:Install 1 Package 2026-03-07T01:33:05.454 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:05.454 INFO:teuthology.orchestra.run.vm07.stdout:Total download size: 28 k 2026-03-07T01:33:05.454 INFO:teuthology.orchestra.run.vm07.stdout:Installed size: 33 k 2026-03-07T01:33:05.454 INFO:teuthology.orchestra.run.vm07.stdout:Downloading Packages: 2026-03-07T01:33:06.219 INFO:teuthology.orchestra.run.vm07.stdout:libffi-devel-3.4.2-8.el9.x86_64.rpm 46 kB/s | 28 kB 00:00 2026-03-07T01:33:06.220 INFO:teuthology.orchestra.run.vm07.stdout:-------------------------------------------------------------------------------- 2026-03-07T01:33:06.220 INFO:teuthology.orchestra.run.vm07.stdout:Total 37 kB/s | 28 kB 00:00 2026-03-07T01:33:06.233 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:33:06.236 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:33:06.236 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:33:06.238 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:33:06.238 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:33:06.263 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:33:06.281 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libffi-devel-3.4.2-8.el9.x86_64 1/1 2026-03-07T01:33:06.367 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libffi-devel-3.4.2-8.el9.x86_64 1/1 2026-03-07T01:33:06.422 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libffi-devel-3.4.2-8.el9.x86_64 1/1 2026-03-07T01:33:06.422 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:06.422 INFO:teuthology.orchestra.run.vm07.stdout:Installed: 2026-03-07T01:33:06.422 INFO:teuthology.orchestra.run.vm07.stdout: libffi-devel-3.4.2-8.el9.x86_64 2026-03-07T01:33:06.422 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:06.422 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:33:06.458 INFO:teuthology.packaging:Installing package libxml2-devel on ubuntu@vm07.local 2026-03-07T01:33:06.458 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y install libxml2-devel 2026-03-07T01:33:06.866 INFO:teuthology.orchestra.run.vm07.stdout:Last metadata expiration check: 0:01:27 ago on Sat 07 Mar 2026 01:31:39 AM CET. 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout:Installing: 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout: libxml2-devel x86_64 2.9.13-14.el9_7 appstream 828 k 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout:Upgrading: 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout: libxml2 x86_64 2.9.13-14.el9_7 baseos 746 k 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout: python3-libxml2 x86_64 2.9.13-14.el9_7 baseos 225 k 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout:Installing dependencies: 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout: cmake-filesystem x86_64 3.26.5-3.el9_7 appstream 11 k 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout: xz-devel x86_64 5.2.5-8.el9_0 appstream 52 k 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 44 k 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout:Install 4 Packages 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout:Upgrade 2 Packages 2026-03-07T01:33:06.949 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:06.950 INFO:teuthology.orchestra.run.vm07.stdout:Total download size: 1.9 M 2026-03-07T01:33:06.950 INFO:teuthology.orchestra.run.vm07.stdout:Downloading Packages: 2026-03-07T01:33:07.499 INFO:teuthology.orchestra.run.vm07.stdout:(1/6): cmake-filesystem-3.26.5-3.el9_7.x86_64.r 44 kB/s | 11 kB 00:00 2026-03-07T01:33:07.748 INFO:teuthology.orchestra.run.vm07.stdout:(2/6): zlib-devel-1.2.11-40.el9.x86_64.rpm 177 kB/s | 44 kB 00:00 2026-03-07T01:33:07.749 INFO:teuthology.orchestra.run.vm07.stdout:(3/6): xz-devel-5.2.5-8.el9_0.x86_64.rpm 105 kB/s | 52 kB 00:00 2026-03-07T01:33:08.241 INFO:teuthology.orchestra.run.vm07.stdout:(4/6): libxml2-devel-2.9.13-14.el9_7.x86_64.rpm 838 kB/s | 828 kB 00:00 2026-03-07T01:33:08.362 INFO:teuthology.orchestra.run.vm07.stdout:(5/6): python3-libxml2-2.9.13-14.el9_7.x86_64.r 367 kB/s | 225 kB 00:00 2026-03-07T01:33:08.768 INFO:teuthology.orchestra.run.vm07.stdout:(6/6): libxml2-2.9.13-14.el9_7.x86_64.rpm 731 kB/s | 746 kB 00:01 2026-03-07T01:33:08.769 INFO:teuthology.orchestra.run.vm07.stdout:-------------------------------------------------------------------------------- 2026-03-07T01:33:08.770 INFO:teuthology.orchestra.run.vm07.stdout:Total 1.0 MB/s | 1.9 MB 00:01 2026-03-07T01:33:08.827 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:33:08.837 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:33:08.837 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:33:08.871 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:33:08.871 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:33:08.936 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:33:08.941 INFO:teuthology.orchestra.run.vm07.stdout: Upgrading : libxml2-2.9.13-14.el9_7.x86_64 1/8 2026-03-07T01:33:08.948 INFO:teuthology.orchestra.run.vm07.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 2/8 2026-03-07T01:33:08.954 INFO:teuthology.orchestra.run.vm07.stdout: Installing : xz-devel-5.2.5-8.el9_0.x86_64 3/8 2026-03-07T01:33:09.042 INFO:teuthology.orchestra.run.vm07.stdout: Installing : cmake-filesystem-3.26.5-3.el9_7.x86_64 4/8 2026-03-07T01:33:09.051 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libxml2-devel-2.9.13-14.el9_7.x86_64 5/8 2026-03-07T01:33:09.054 INFO:teuthology.orchestra.run.vm07.stdout: Upgrading : python3-libxml2-2.9.13-14.el9_7.x86_64 6/8 2026-03-07T01:33:09.056 INFO:teuthology.orchestra.run.vm07.stdout: Cleanup : python3-libxml2-2.9.13-12.el9_6.x86_64 7/8 2026-03-07T01:33:09.074 INFO:teuthology.orchestra.run.vm07.stdout: Cleanup : libxml2-2.9.13-12.el9_6.x86_64 8/8 2026-03-07T01:33:09.209 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libxml2-2.9.13-12.el9_6.x86_64 8/8 2026-03-07T01:33:09.209 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : cmake-filesystem-3.26.5-3.el9_7.x86_64 1/8 2026-03-07T01:33:09.209 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libxml2-devel-2.9.13-14.el9_7.x86_64 2/8 2026-03-07T01:33:09.209 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : xz-devel-5.2.5-8.el9_0.x86_64 3/8 2026-03-07T01:33:09.209 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 4/8 2026-03-07T01:33:09.210 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libxml2-2.9.13-14.el9_7.x86_64 5/8 2026-03-07T01:33:09.210 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libxml2-2.9.13-12.el9_6.x86_64 6/8 2026-03-07T01:33:09.210 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-libxml2-2.9.13-14.el9_7.x86_64 7/8 2026-03-07T01:33:09.271 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-libxml2-2.9.13-12.el9_6.x86_64 8/8 2026-03-07T01:33:09.271 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:09.271 INFO:teuthology.orchestra.run.vm07.stdout:Upgraded: 2026-03-07T01:33:09.271 INFO:teuthology.orchestra.run.vm07.stdout: libxml2-2.9.13-14.el9_7.x86_64 python3-libxml2-2.9.13-14.el9_7.x86_64 2026-03-07T01:33:09.271 INFO:teuthology.orchestra.run.vm07.stdout:Installed: 2026-03-07T01:33:09.271 INFO:teuthology.orchestra.run.vm07.stdout: cmake-filesystem-3.26.5-3.el9_7.x86_64 libxml2-devel-2.9.13-14.el9_7.x86_64 2026-03-07T01:33:09.271 INFO:teuthology.orchestra.run.vm07.stdout: xz-devel-5.2.5-8.el9_0.x86_64 zlib-devel-1.2.11-40.el9.x86_64 2026-03-07T01:33:09.271 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:09.271 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:33:09.322 INFO:teuthology.packaging:Installing package libxslt-devel on ubuntu@vm07.local 2026-03-07T01:33:09.322 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y install libxslt-devel 2026-03-07T01:33:09.770 INFO:teuthology.orchestra.run.vm07.stdout:Last metadata expiration check: 0:01:30 ago on Sat 07 Mar 2026 01:31:39 AM CET. 2026-03-07T01:33:09.852 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:33:09.852 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:09.852 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:33:09.852 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:09.852 INFO:teuthology.orchestra.run.vm07.stdout:Installing: 2026-03-07T01:33:09.852 INFO:teuthology.orchestra.run.vm07.stdout: libxslt-devel x86_64 1.1.34-13.el9_6 appstream 287 k 2026-03-07T01:33:09.852 INFO:teuthology.orchestra.run.vm07.stdout:Installing dependencies: 2026-03-07T01:33:09.852 INFO:teuthology.orchestra.run.vm07.stdout: libgpg-error-devel x86_64 1.42-5.el9 appstream 65 k 2026-03-07T01:33:09.852 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:09.852 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:33:09.852 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:09.852 INFO:teuthology.orchestra.run.vm07.stdout:Install 2 Packages 2026-03-07T01:33:09.852 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:09.853 INFO:teuthology.orchestra.run.vm07.stdout:Total download size: 352 k 2026-03-07T01:33:09.853 INFO:teuthology.orchestra.run.vm07.stdout:Installed size: 2.7 M 2026-03-07T01:33:09.853 INFO:teuthology.orchestra.run.vm07.stdout:Downloading Packages: 2026-03-07T01:33:10.659 INFO:teuthology.orchestra.run.vm07.stdout:(1/2): libgpg-error-devel-1.42-5.el9.x86_64.rpm 103 kB/s | 65 kB 00:00 2026-03-07T01:33:10.975 INFO:teuthology.orchestra.run.vm07.stdout:(2/2): libxslt-devel-1.1.34-13.el9_6.x86_64.rpm 302 kB/s | 287 kB 00:00 2026-03-07T01:33:10.975 INFO:teuthology.orchestra.run.vm07.stdout:-------------------------------------------------------------------------------- 2026-03-07T01:33:10.975 INFO:teuthology.orchestra.run.vm07.stdout:Total 314 kB/s | 352 kB 00:01 2026-03-07T01:33:10.995 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:33:10.999 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:33:10.999 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:33:11.026 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:33:11.026 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:33:11.073 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:33:11.116 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libgpg-error-devel-1.42-5.el9.x86_64 1/2 2026-03-07T01:33:11.139 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libxslt-devel-1.1.34-13.el9_6.x86_64 2/2 2026-03-07T01:33:11.235 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libxslt-devel-1.1.34-13.el9_6.x86_64 2/2 2026-03-07T01:33:11.235 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libgpg-error-devel-1.42-5.el9.x86_64 1/2 2026-03-07T01:33:11.296 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libxslt-devel-1.1.34-13.el9_6.x86_64 2/2 2026-03-07T01:33:11.296 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:11.296 INFO:teuthology.orchestra.run.vm07.stdout:Installed: 2026-03-07T01:33:11.296 INFO:teuthology.orchestra.run.vm07.stdout: libgpg-error-devel-1.42-5.el9.x86_64 libxslt-devel-1.1.34-13.el9_6.x86_64 2026-03-07T01:33:11.296 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:11.296 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:33:11.339 INFO:teuthology.packaging:Installing package mariadb on ubuntu@vm07.local 2026-03-07T01:33:11.339 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y install mariadb 2026-03-07T01:33:11.785 INFO:teuthology.orchestra.run.vm07.stdout:Last metadata expiration check: 0:01:32 ago on Sat 07 Mar 2026 01:31:39 AM CET. 2026-03-07T01:33:11.859 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout:Installing: 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout: mariadb x86_64 3:10.5.29-3.el9_7 appstream 1.6 M 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout:Installing dependencies: 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-common x86_64 3:10.5.29-3.el9_7 appstream 27 k 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c x86_64 3.2.6-1.el9_0 appstream 195 k 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c-config noarch 3.2.6-1.el9_0 appstream 9.8 k 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout: perl-Sys-Hostname x86_64 1.23-481.1.el9_6 appstream 15 k 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout:Install 5 Packages 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout:Total download size: 1.9 M 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout:Installed size: 22 M 2026-03-07T01:33:11.860 INFO:teuthology.orchestra.run.vm07.stdout:Downloading Packages: 2026-03-07T01:33:12.387 INFO:teuthology.orchestra.run.vm07.stdout:(1/5): mariadb-common-10.5.29-3.el9_7.x86_64.rp 71 kB/s | 27 kB 00:00 2026-03-07T01:33:12.516 INFO:teuthology.orchestra.run.vm07.stdout:(2/5): mariadb-connector-c-config-3.2.6-1.el9_0 76 kB/s | 9.8 kB 00:00 2026-03-07T01:33:12.646 INFO:teuthology.orchestra.run.vm07.stdout:(3/5): perl-Sys-Hostname-1.23-481.1.el9_6.x86_6 120 kB/s | 15 kB 00:00 2026-03-07T01:33:12.744 INFO:teuthology.orchestra.run.vm07.stdout:(4/5): mariadb-connector-c-3.2.6-1.el9_0.x86_64 267 kB/s | 195 kB 00:00 2026-03-07T01:33:13.136 INFO:teuthology.orchestra.run.vm07.stdout:(5/5): mariadb-10.5.29-3.el9_7.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2026-03-07T01:33:13.137 INFO:teuthology.orchestra.run.vm07.stdout:-------------------------------------------------------------------------------- 2026-03-07T01:33:13.137 INFO:teuthology.orchestra.run.vm07.stdout:Total 1.5 MB/s | 1.9 MB 00:01 2026-03-07T01:33:13.183 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:33:13.190 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:33:13.190 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:33:13.222 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:33:13.223 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:33:13.278 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:33:13.288 INFO:teuthology.orchestra.run.vm07.stdout: Installing : mariadb-connector-c-config-3.2.6-1.el9_0.noarch 1/5 2026-03-07T01:33:13.296 INFO:teuthology.orchestra.run.vm07.stdout: Installing : mariadb-common-3:10.5.29-3.el9_7.x86_64 2/5 2026-03-07T01:33:13.300 INFO:teuthology.orchestra.run.vm07.stdout: Installing : mariadb-connector-c-3.2.6-1.el9_0.x86_64 3/5 2026-03-07T01:33:13.339 INFO:teuthology.orchestra.run.vm07.stdout: Installing : perl-Sys-Hostname-1.23-481.1.el9_6.x86_64 4/5 2026-03-07T01:33:13.369 INFO:teuthology.orchestra.run.vm07.stdout: Installing : mariadb-3:10.5.29-3.el9_7.x86_64 5/5 2026-03-07T01:33:13.501 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: mariadb-3:10.5.29-3.el9_7.x86_64 5/5 2026-03-07T01:33:13.502 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-3:10.5.29-3.el9_7.x86_64 1/5 2026-03-07T01:33:13.502 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-common-3:10.5.29-3.el9_7.x86_64 2/5 2026-03-07T01:33:13.502 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-connector-c-3.2.6-1.el9_0.x86_64 3/5 2026-03-07T01:33:13.502 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-connector-c-config-3.2.6-1.el9_0.noarch 4/5 2026-03-07T01:33:13.565 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : perl-Sys-Hostname-1.23-481.1.el9_6.x86_64 5/5 2026-03-07T01:33:13.565 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:13.565 INFO:teuthology.orchestra.run.vm07.stdout:Installed: 2026-03-07T01:33:13.565 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:33:13.565 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-common-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:33:13.565 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c-3.2.6-1.el9_0.x86_64 2026-03-07T01:33:13.565 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c-config-3.2.6-1.el9_0.noarch 2026-03-07T01:33:13.565 INFO:teuthology.orchestra.run.vm07.stdout: perl-Sys-Hostname-1.23-481.1.el9_6.x86_64 2026-03-07T01:33:13.565 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:13.565 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:33:13.619 INFO:teuthology.packaging:Installing package mariadb-devel on ubuntu@vm07.local 2026-03-07T01:33:13.619 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y install mariadb-devel 2026-03-07T01:33:14.097 INFO:teuthology.orchestra.run.vm07.stdout:Last metadata expiration check: 0:01:35 ago on Sat 07 Mar 2026 01:31:39 AM CET. 2026-03-07T01:33:14.193 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:33:14.193 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:14.193 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:33:14.193 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:14.193 INFO:teuthology.orchestra.run.vm07.stdout:Installing: 2026-03-07T01:33:14.193 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-devel x86_64 3:10.5.29-3.el9_7 crb 1.0 M 2026-03-07T01:33:14.193 INFO:teuthology.orchestra.run.vm07.stdout:Installing dependencies: 2026-03-07T01:33:14.193 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c-devel x86_64 3.2.6-1.el9_0 appstream 55 k 2026-03-07T01:33:14.193 INFO:teuthology.orchestra.run.vm07.stdout: openssl-devel x86_64 1:3.5.1-4.el9_7 appstream 3.4 M 2026-03-07T01:33:14.193 INFO:teuthology.orchestra.run.vm07.stdout:Installing weak dependencies: 2026-03-07T01:33:14.193 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c-doc noarch 3.2.6-1.el9_0 crb 98 k 2026-03-07T01:33:14.193 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:14.194 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:33:14.194 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:14.194 INFO:teuthology.orchestra.run.vm07.stdout:Install 4 Packages 2026-03-07T01:33:14.194 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:14.194 INFO:teuthology.orchestra.run.vm07.stdout:Total download size: 4.6 M 2026-03-07T01:33:14.194 INFO:teuthology.orchestra.run.vm07.stdout:Installed size: 11 M 2026-03-07T01:33:14.194 INFO:teuthology.orchestra.run.vm07.stdout:Downloading Packages: 2026-03-07T01:33:14.802 INFO:teuthology.orchestra.run.vm07.stdout:(1/4): mariadb-connector-c-doc-3.2.6-1.el9_0.no 324 kB/s | 98 kB 00:00 2026-03-07T01:33:15.281 INFO:teuthology.orchestra.run.vm07.stdout:(2/4): mariadb-connector-c-devel-3.2.6-1.el9_0. 70 kB/s | 55 kB 00:00 2026-03-07T01:33:15.479 INFO:teuthology.orchestra.run.vm07.stdout:(3/4): mariadb-devel-10.5.29-3.el9_7.x86_64.rpm 1.5 MB/s | 1.0 MB 00:00 2026-03-07T01:33:16.353 INFO:teuthology.orchestra.run.vm07.stdout:(4/4): openssl-devel-3.5.1-4.el9_7.x86_64.rpm 1.8 MB/s | 3.4 MB 00:01 2026-03-07T01:33:16.356 INFO:teuthology.orchestra.run.vm07.stdout:-------------------------------------------------------------------------------- 2026-03-07T01:33:16.357 INFO:teuthology.orchestra.run.vm07.stdout:Total 2.1 MB/s | 4.6 MB 00:02 2026-03-07T01:33:16.417 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:33:16.425 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:33:16.425 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:33:16.518 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:33:16.518 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:33:17.172 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:33:17.221 INFO:teuthology.orchestra.run.vm07.stdout: Installing : openssl-devel-1:3.5.1-4.el9_7.x86_64 1/4 2026-03-07T01:33:17.229 INFO:teuthology.orchestra.run.vm07.stdout: Installing : mariadb-connector-c-doc-3.2.6-1.el9_0.noarch 2/4 2026-03-07T01:33:17.327 INFO:teuthology.orchestra.run.vm07.stdout: Installing : mariadb-connector-c-devel-3.2.6-1.el9_0.x86_64 3/4 2026-03-07T01:33:17.349 INFO:teuthology.orchestra.run.vm07.stdout: Installing : mariadb-devel-3:10.5.29-3.el9_7.x86_64 4/4 2026-03-07T01:33:17.466 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: mariadb-devel-3:10.5.29-3.el9_7.x86_64 4/4 2026-03-07T01:33:17.466 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-connector-c-devel-3.2.6-1.el9_0.x86_64 1/4 2026-03-07T01:33:17.466 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openssl-devel-1:3.5.1-4.el9_7.x86_64 2/4 2026-03-07T01:33:17.466 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-connector-c-doc-3.2.6-1.el9_0.noarch 3/4 2026-03-07T01:33:17.518 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-devel-3:10.5.29-3.el9_7.x86_64 4/4 2026-03-07T01:33:17.518 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:17.518 INFO:teuthology.orchestra.run.vm07.stdout:Installed: 2026-03-07T01:33:17.518 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c-devel-3.2.6-1.el9_0.x86_64 2026-03-07T01:33:17.518 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c-doc-3.2.6-1.el9_0.noarch 2026-03-07T01:33:17.518 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-devel-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:33:17.518 INFO:teuthology.orchestra.run.vm07.stdout: openssl-devel-1:3.5.1-4.el9_7.x86_64 2026-03-07T01:33:17.518 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:17.518 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:33:17.583 INFO:teuthology.packaging:Installing package mariadb-server on ubuntu@vm07.local 2026-03-07T01:33:17.583 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y install mariadb-server 2026-03-07T01:33:18.182 INFO:teuthology.orchestra.run.vm07.stdout:Last metadata expiration check: 0:01:39 ago on Sat 07 Mar 2026 01:31:39 AM CET. 2026-03-07T01:33:18.296 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout:Installing: 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-server x86_64 3:10.5.29-3.el9_7 appstream 9.7 M 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout:Installing dependencies: 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-errmsg x86_64 3:10.5.29-3.el9_7 appstream 210 k 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout: mysql-selinux noarch 1.0.14-1.el9_6 appstream 36 k 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout: perl-DBD-MariaDB x86_64 1.21-17.el9 appstream 149 k 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout: perl-DBI x86_64 1.643-9.el9 appstream 700 k 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout: perl-Math-BigInt noarch 1:1.9998.18-460.el9 appstream 188 k 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout: perl-Math-Complex noarch 1.59-481.1.el9_6 appstream 45 k 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout:Installing weak dependencies: 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-backup x86_64 3:10.5.29-3.el9_7 appstream 6.5 M 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-gssapi-server x86_64 3:10.5.29-3.el9_7 appstream 14 k 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-server-utils x86_64 3:10.5.29-3.el9_7 appstream 210 k 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout:Install 10 Packages 2026-03-07T01:33:18.297 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:18.299 INFO:teuthology.orchestra.run.vm07.stdout:Total download size: 18 M 2026-03-07T01:33:18.299 INFO:teuthology.orchestra.run.vm07.stdout:Installed size: 94 M 2026-03-07T01:33:18.299 INFO:teuthology.orchestra.run.vm07.stdout:Downloading Packages: 2026-03-07T01:33:19.228 INFO:teuthology.orchestra.run.vm07.stdout:(1/10): mariadb-gssapi-server-10.5.29-3.el9_7.x 18 kB/s | 14 kB 00:00 2026-03-07T01:33:20.663 INFO:teuthology.orchestra.run.vm07.stdout:(2/10): mariadb-errmsg-10.5.29-3.el9_7.x86_64.r 95 kB/s | 210 kB 00:02 2026-03-07T01:33:22.828 INFO:teuthology.orchestra.run.vm07.stdout:(3/10): mariadb-server-utils-10.5.29-3.el9_7.x8 97 kB/s | 210 kB 00:02 2026-03-07T01:33:23.974 INFO:teuthology.orchestra.run.vm07.stdout:(4/10): mysql-selinux-1.0.14-1.el9_6.noarch.rpm 32 kB/s | 36 kB 00:01 2026-03-07T01:33:25.251 INFO:teuthology.orchestra.run.vm07.stdout:(5/10): perl-DBD-MariaDB-1.21-17.el9.x86_64.rpm 117 kB/s | 149 kB 00:01 2026-03-07T01:33:26.908 INFO:teuthology.orchestra.run.vm07.stdout:(6/10): perl-DBI-1.643-9.el9.x86_64.rpm 423 kB/s | 700 kB 00:01 2026-03-07T01:33:27.367 INFO:teuthology.orchestra.run.vm07.stdout:(7/10): mariadb-backup-10.5.29-3.el9_7.x86_64.r 746 kB/s | 6.5 MB 00:08 2026-03-07T01:33:27.887 INFO:teuthology.orchestra.run.vm07.stdout:(8/10): perl-Math-BigInt-1.9998.18-460.el9.noar 192 kB/s | 188 kB 00:00 2026-03-07T01:33:28.269 INFO:teuthology.orchestra.run.vm07.stdout:(9/10): perl-Math-Complex-1.59-481.1.el9_6.noar 50 kB/s | 45 kB 00:00 2026-03-07T01:33:28.847 INFO:teuthology.orchestra.run.vm07.stdout:(10/10): mariadb-server-10.5.29-3.el9_7.x86_64. 1.0 MB/s | 9.7 MB 00:09 2026-03-07T01:33:28.849 INFO:teuthology.orchestra.run.vm07.stdout:-------------------------------------------------------------------------------- 2026-03-07T01:33:28.849 INFO:teuthology.orchestra.run.vm07.stdout:Total 1.7 MB/s | 18 MB 00:10 2026-03-07T01:33:28.979 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:33:28.993 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:33:28.993 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:33:29.082 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:33:29.082 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:33:29.196 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:33:29.204 INFO:teuthology.orchestra.run.vm07.stdout: Installing : perl-Math-Complex-1.59-481.1.el9_6.noarch 1/10 2026-03-07T01:33:29.234 INFO:teuthology.orchestra.run.vm07.stdout: Installing : perl-Math-BigInt-1:1.9998.18-460.el9.noarch 2/10 2026-03-07T01:33:29.241 INFO:teuthology.orchestra.run.vm07.stdout: Installing : perl-DBI-1.643-9.el9.x86_64 3/10 2026-03-07T01:33:29.243 INFO:teuthology.orchestra.run.vm07.stdout: Installing : perl-DBD-MariaDB-1.21-17.el9.x86_64 4/10 2026-03-07T01:33:29.253 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: mysql-selinux-1.0.14-1.el9_6.noarch 5/10 2026-03-07T01:33:29.254 INFO:teuthology.orchestra.run.vm07.stdout: Installing : mysql-selinux-1.0.14-1.el9_6.noarch 5/10 2026-03-07T01:33:34.512 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: mysql-selinux-1.0.14-1.el9_6.noarch 5/10 2026-03-07T01:33:34.512 INFO:teuthology.orchestra.run.vm07.stdout:libsemanage.semanage_direct_install_info: Overriding mysql module at lower priority 100 with module at priority 200. 2026-03-07T01:33:34.512 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:34.536 INFO:teuthology.orchestra.run.vm07.stdout: Installing : mariadb-errmsg-3:10.5.29-3.el9_7.x86_64 6/10 2026-03-07T01:33:34.546 INFO:teuthology.orchestra.run.vm07.stdout: Installing : mariadb-gssapi-server-3:10.5.29-3.el9_7.x86_64 7/10 2026-03-07T01:33:34.549 INFO:teuthology.orchestra.run.vm07.stdout: Installing : mariadb-server-utils-3:10.5.29-3.el9_7.x86_64 8/10 2026-03-07T01:33:34.735 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: mariadb-server-3:10.5.29-3.el9_7.x86_64 9/10 2026-03-07T01:33:34.741 INFO:teuthology.orchestra.run.vm07.stdout: Installing : mariadb-server-3:10.5.29-3.el9_7.x86_64 9/10 2026-03-07T01:33:34.809 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: mariadb-server-3:10.5.29-3.el9_7.x86_64 9/10 2026-03-07T01:33:34.812 INFO:teuthology.orchestra.run.vm07.stdout: Installing : mariadb-backup-3:10.5.29-3.el9_7.x86_64 10/10 2026-03-07T01:33:35.313 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: mysql-selinux-1.0.14-1.el9_6.noarch 10/10 2026-03-07T01:33:35.906 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: mariadb-backup-3:10.5.29-3.el9_7.x86_64 10/10 2026-03-07T01:33:35.906 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-backup-3:10.5.29-3.el9_7.x86_64 1/10 2026-03-07T01:33:35.906 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-errmsg-3:10.5.29-3.el9_7.x86_64 2/10 2026-03-07T01:33:35.906 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-gssapi-server-3:10.5.29-3.el9_7.x86_64 3/10 2026-03-07T01:33:35.906 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-server-3:10.5.29-3.el9_7.x86_64 4/10 2026-03-07T01:33:35.906 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-server-utils-3:10.5.29-3.el9_7.x86_64 5/10 2026-03-07T01:33:35.906 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mysql-selinux-1.0.14-1.el9_6.noarch 6/10 2026-03-07T01:33:35.906 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : perl-DBD-MariaDB-1.21-17.el9.x86_64 7/10 2026-03-07T01:33:35.906 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : perl-DBI-1.643-9.el9.x86_64 8/10 2026-03-07T01:33:35.906 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : perl-Math-BigInt-1:1.9998.18-460.el9.noarch 9/10 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : perl-Math-Complex-1.59-481.1.el9_6.noarch 10/10 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout:Installed: 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-backup-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-errmsg-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-gssapi-server-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-server-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-server-utils-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout: mysql-selinux-1.0.14-1.el9_6.noarch 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout: perl-DBD-MariaDB-1.21-17.el9.x86_64 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout: perl-DBI-1.643-9.el9.x86_64 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout: perl-Math-BigInt-1:1.9998.18-460.el9.noarch 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout: perl-Math-Complex-1.59-481.1.el9_6.noarch 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:35.978 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:33:36.038 INFO:teuthology.packaging:Installing package openldap-devel on ubuntu@vm07.local 2026-03-07T01:33:36.038 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y install openldap-devel 2026-03-07T01:33:36.651 INFO:teuthology.orchestra.run.vm07.stdout:Last metadata expiration check: 0:01:57 ago on Sat 07 Mar 2026 01:31:39 AM CET. 2026-03-07T01:33:36.772 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:33:36.772 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:36.772 INFO:teuthology.orchestra.run.vm07.stdout: Package Architecture Version Repository Size 2026-03-07T01:33:36.772 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:36.772 INFO:teuthology.orchestra.run.vm07.stdout:Installing: 2026-03-07T01:33:36.772 INFO:teuthology.orchestra.run.vm07.stdout: openldap-devel x86_64 2.6.8-4.el9.0.1 appstream 684 k 2026-03-07T01:33:36.772 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:36.772 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:33:36.773 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:36.773 INFO:teuthology.orchestra.run.vm07.stdout:Install 1 Package 2026-03-07T01:33:36.773 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:36.773 INFO:teuthology.orchestra.run.vm07.stdout:Total download size: 684 k 2026-03-07T01:33:36.773 INFO:teuthology.orchestra.run.vm07.stdout:Installed size: 3.7 M 2026-03-07T01:33:36.773 INFO:teuthology.orchestra.run.vm07.stdout:Downloading Packages: 2026-03-07T01:33:38.110 INFO:teuthology.orchestra.run.vm07.stdout:openldap-devel-2.6.8-4.el9.0.1.x86_64.rpm 578 kB/s | 684 kB 00:01 2026-03-07T01:33:38.111 INFO:teuthology.orchestra.run.vm07.stdout:-------------------------------------------------------------------------------- 2026-03-07T01:33:38.111 INFO:teuthology.orchestra.run.vm07.stdout:Total 511 kB/s | 684 kB 00:01 2026-03-07T01:33:38.125 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:33:38.128 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:33:38.129 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:33:38.143 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:33:38.143 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:33:38.247 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:33:38.269 INFO:teuthology.orchestra.run.vm07.stdout: Installing : openldap-devel-2.6.8-4.el9.0.1.x86_64 1/1 2026-03-07T01:33:38.368 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: openldap-devel-2.6.8-4.el9.0.1.x86_64 1/1 2026-03-07T01:33:38.418 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openldap-devel-2.6.8-4.el9.0.1.x86_64 1/1 2026-03-07T01:33:38.418 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:38.418 INFO:teuthology.orchestra.run.vm07.stdout:Installed: 2026-03-07T01:33:38.418 INFO:teuthology.orchestra.run.vm07.stdout: openldap-devel-2.6.8-4.el9.0.1.x86_64 2026-03-07T01:33:38.418 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:38.418 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:33:38.459 INFO:teuthology.packaging:Installing package openssl-devel on ubuntu@vm07.local 2026-03-07T01:33:38.459 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y install openssl-devel 2026-03-07T01:33:39.099 INFO:teuthology.orchestra.run.vm07.stdout:Last metadata expiration check: 0:02:00 ago on Sat 07 Mar 2026 01:31:39 AM CET. 2026-03-07T01:33:39.203 INFO:teuthology.orchestra.run.vm07.stdout:Package openssl-devel-1:3.5.1-4.el9_7.x86_64 is already installed. 2026-03-07T01:33:39.223 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:33:39.225 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:39.225 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:33:39.225 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:39.225 INFO:teuthology.orchestra.run.vm07.stdout:Upgrading: 2026-03-07T01:33:39.225 INFO:teuthology.orchestra.run.vm07.stdout: openssl x86_64 1:3.5.1-7.el9_7 baseos 1.4 M 2026-03-07T01:33:39.225 INFO:teuthology.orchestra.run.vm07.stdout: openssl-devel x86_64 1:3.5.1-7.el9_7 appstream 3.4 M 2026-03-07T01:33:39.225 INFO:teuthology.orchestra.run.vm07.stdout: openssl-fips-provider x86_64 1:3.5.1-7.el9_7 baseos 812 k 2026-03-07T01:33:39.225 INFO:teuthology.orchestra.run.vm07.stdout: openssl-libs x86_64 1:3.5.1-7.el9_7 baseos 2.3 M 2026-03-07T01:33:39.225 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:39.225 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:33:39.225 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:39.225 INFO:teuthology.orchestra.run.vm07.stdout:Upgrade 4 Packages 2026-03-07T01:33:39.225 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:39.226 INFO:teuthology.orchestra.run.vm07.stdout:Total download size: 7.9 M 2026-03-07T01:33:39.226 INFO:teuthology.orchestra.run.vm07.stdout:Downloading Packages: 2026-03-07T01:33:40.506 INFO:teuthology.orchestra.run.vm07.stdout:(1/4): openssl-fips-provider-3.5.1-7.el9_7.x86_ 829 kB/s | 812 kB 00:00 2026-03-07T01:33:40.597 INFO:teuthology.orchestra.run.vm07.stdout:(2/4): openssl-3.5.1-7.el9_7.x86_64.rpm 1.3 MB/s | 1.4 MB 00:01 2026-03-07T01:33:40.672 INFO:teuthology.orchestra.run.vm07.stdout:(3/4): openssl-libs-3.5.1-7.el9_7.x86_64.rpm 2.0 MB/s | 2.3 MB 00:01 2026-03-07T01:33:41.594 INFO:teuthology.orchestra.run.vm07.stdout:(4/4): openssl-devel-3.5.1-7.el9_7.x86_64.rpm 3.1 MB/s | 3.4 MB 00:01 2026-03-07T01:33:41.596 INFO:teuthology.orchestra.run.vm07.stdout:-------------------------------------------------------------------------------- 2026-03-07T01:33:41.597 INFO:teuthology.orchestra.run.vm07.stdout:Total 3.3 MB/s | 7.9 MB 00:02 2026-03-07T01:33:41.655 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:33:41.681 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:33:41.681 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:33:41.785 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:33:41.785 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:33:41.929 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:33:41.938 INFO:teuthology.orchestra.run.vm07.stdout: Upgrading : openssl-libs-1:3.5.1-7.el9_7.x86_64 1/8 2026-03-07T01:33:42.012 INFO:teuthology.orchestra.run.vm07.stdout: Upgrading : openssl-fips-provider-1:3.5.1-7.el9_7.x86_64 2/8 2026-03-07T01:33:42.651 INFO:teuthology.orchestra.run.vm07.stdout: Upgrading : openssl-1:3.5.1-7.el9_7.x86_64 3/8 2026-03-07T01:33:42.688 INFO:teuthology.orchestra.run.vm07.stdout: Upgrading : openssl-devel-1:3.5.1-7.el9_7.x86_64 4/8 2026-03-07T01:33:42.694 INFO:teuthology.orchestra.run.vm07.stdout: Cleanup : openssl-1:3.5.1-4.el9_7.x86_64 5/8 2026-03-07T01:33:42.704 INFO:teuthology.orchestra.run.vm07.stdout: Cleanup : openssl-devel-1:3.5.1-4.el9_7.x86_64 6/8 2026-03-07T01:33:42.706 INFO:teuthology.orchestra.run.vm07.stdout: Cleanup : openssl-fips-provider-1:3.5.1-4.el9_7.x86_64 7/8 2026-03-07T01:33:42.725 INFO:teuthology.orchestra.run.vm07.stdout: Cleanup : openssl-libs-1:3.5.1-4.el9_7.x86_64 8/8 2026-03-07T01:33:42.888 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: openssl-libs-1:3.5.1-4.el9_7.x86_64 8/8 2026-03-07T01:33:42.888 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openssl-1:3.5.1-7.el9_7.x86_64 1/8 2026-03-07T01:33:42.888 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openssl-1:3.5.1-4.el9_7.x86_64 2/8 2026-03-07T01:33:42.888 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openssl-fips-provider-1:3.5.1-7.el9_7.x86_64 3/8 2026-03-07T01:33:42.888 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openssl-fips-provider-1:3.5.1-4.el9_7.x86_64 4/8 2026-03-07T01:33:42.888 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openssl-libs-1:3.5.1-7.el9_7.x86_64 5/8 2026-03-07T01:33:42.888 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openssl-libs-1:3.5.1-4.el9_7.x86_64 6/8 2026-03-07T01:33:42.888 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openssl-devel-1:3.5.1-7.el9_7.x86_64 7/8 2026-03-07T01:33:42.955 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openssl-devel-1:3.5.1-4.el9_7.x86_64 8/8 2026-03-07T01:33:42.955 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:42.955 INFO:teuthology.orchestra.run.vm07.stdout:Upgraded: 2026-03-07T01:33:42.955 INFO:teuthology.orchestra.run.vm07.stdout: openssl-1:3.5.1-7.el9_7.x86_64 2026-03-07T01:33:42.955 INFO:teuthology.orchestra.run.vm07.stdout: openssl-devel-1:3.5.1-7.el9_7.x86_64 2026-03-07T01:33:42.955 INFO:teuthology.orchestra.run.vm07.stdout: openssl-fips-provider-1:3.5.1-7.el9_7.x86_64 2026-03-07T01:33:42.955 INFO:teuthology.orchestra.run.vm07.stdout: openssl-libs-1:3.5.1-7.el9_7.x86_64 2026-03-07T01:33:42.955 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:42.955 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:33:43.018 INFO:teuthology.packaging:Installing package postgresql on ubuntu@vm07.local 2026-03-07T01:33:43.018 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y install postgresql 2026-03-07T01:33:43.616 INFO:teuthology.orchestra.run.vm07.stdout:Last metadata expiration check: 0:02:04 ago on Sat 07 Mar 2026 01:31:39 AM CET. 2026-03-07T01:33:43.745 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:33:43.745 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:43.745 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:33:43.745 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:43.745 INFO:teuthology.orchestra.run.vm07.stdout:Installing: 2026-03-07T01:33:43.745 INFO:teuthology.orchestra.run.vm07.stdout: postgresql x86_64 13.23-1.el9_7 appstream 1.6 M 2026-03-07T01:33:43.745 INFO:teuthology.orchestra.run.vm07.stdout:Installing dependencies: 2026-03-07T01:33:43.746 INFO:teuthology.orchestra.run.vm07.stdout: postgresql-private-libs x86_64 13.23-1.el9_7 appstream 140 k 2026-03-07T01:33:43.746 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:43.746 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:33:43.746 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:43.746 INFO:teuthology.orchestra.run.vm07.stdout:Install 2 Packages 2026-03-07T01:33:43.746 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:43.746 INFO:teuthology.orchestra.run.vm07.stdout:Total download size: 1.7 M 2026-03-07T01:33:43.746 INFO:teuthology.orchestra.run.vm07.stdout:Installed size: 6.2 M 2026-03-07T01:33:43.746 INFO:teuthology.orchestra.run.vm07.stdout:Downloading Packages: 2026-03-07T01:33:44.470 INFO:teuthology.orchestra.run.vm07.stdout:(1/2): postgresql-private-libs-13.23-1.el9_7.x8 246 kB/s | 140 kB 00:00 2026-03-07T01:33:44.896 INFO:teuthology.orchestra.run.vm07.stdout:(2/2): postgresql-13.23-1.el9_7.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2026-03-07T01:33:44.896 INFO:teuthology.orchestra.run.vm07.stdout:-------------------------------------------------------------------------------- 2026-03-07T01:33:44.896 INFO:teuthology.orchestra.run.vm07.stdout:Total 1.5 MB/s | 1.7 MB 00:01 2026-03-07T01:33:44.920 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:33:44.925 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:33:44.925 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:33:44.964 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:33:44.964 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:33:45.076 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:33:45.156 INFO:teuthology.orchestra.run.vm07.stdout: Installing : postgresql-private-libs-13.23-1.el9_7.x86_64 1/2 2026-03-07T01:33:45.179 INFO:teuthology.orchestra.run.vm07.stdout: Installing : postgresql-13.23-1.el9_7.x86_64 2/2 2026-03-07T01:33:45.386 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: postgresql-13.23-1.el9_7.x86_64 2/2 2026-03-07T01:33:45.386 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : postgresql-13.23-1.el9_7.x86_64 1/2 2026-03-07T01:33:45.642 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : postgresql-private-libs-13.23-1.el9_7.x86_64 2/2 2026-03-07T01:33:45.642 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:45.642 INFO:teuthology.orchestra.run.vm07.stdout:Installed: 2026-03-07T01:33:45.642 INFO:teuthology.orchestra.run.vm07.stdout: postgresql-13.23-1.el9_7.x86_64 postgresql-private-libs-13.23-1.el9_7.x86_64 2026-03-07T01:33:45.642 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:45.642 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:33:45.764 INFO:teuthology.packaging:Installing package postgresql-devel on ubuntu@vm07.local 2026-03-07T01:33:45.764 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y install postgresql-devel 2026-03-07T01:33:46.320 INFO:teuthology.orchestra.run.vm07.stdout:Last metadata expiration check: 0:02:07 ago on Sat 07 Mar 2026 01:31:39 AM CET. 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout: Package Architecture Version Repository Size 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout:Installing: 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout: libpq-devel x86_64 13.23-1.el9_7 appstream 92 k 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout:Installing dependencies: 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout: libpq x86_64 13.23-1.el9_7 appstream 208 k 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout:Install 2 Packages 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout:Total download size: 300 k 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout:Installed size: 1.0 M 2026-03-07T01:33:46.418 INFO:teuthology.orchestra.run.vm07.stdout:Downloading Packages: 2026-03-07T01:33:46.887 INFO:teuthology.orchestra.run.vm07.stdout:(1/2): libpq-devel-13.23-1.el9_7.x86_64.rpm 291 kB/s | 92 kB 00:00 2026-03-07T01:33:46.986 INFO:teuthology.orchestra.run.vm07.stdout:(2/2): libpq-13.23-1.el9_7.x86_64.rpm 504 kB/s | 208 kB 00:00 2026-03-07T01:33:46.986 INFO:teuthology.orchestra.run.vm07.stdout:-------------------------------------------------------------------------------- 2026-03-07T01:33:46.986 INFO:teuthology.orchestra.run.vm07.stdout:Total 530 kB/s | 300 kB 00:00 2026-03-07T01:33:47.008 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:33:47.012 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:33:47.012 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:33:47.038 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:33:47.038 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:33:47.096 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:33:47.111 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libpq-13.23-1.el9_7.x86_64 1/2 2026-03-07T01:33:47.130 INFO:teuthology.orchestra.run.vm07.stdout: Installing : libpq-devel-13.23-1.el9_7.x86_64 2/2 2026-03-07T01:33:47.192 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libpq-devel-13.23-1.el9_7.x86_64 2/2 2026-03-07T01:33:47.192 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libpq-13.23-1.el9_7.x86_64 1/2 2026-03-07T01:33:47.243 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libpq-devel-13.23-1.el9_7.x86_64 2/2 2026-03-07T01:33:47.243 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:47.243 INFO:teuthology.orchestra.run.vm07.stdout:Installed: 2026-03-07T01:33:47.243 INFO:teuthology.orchestra.run.vm07.stdout: libpq-13.23-1.el9_7.x86_64 libpq-devel-13.23-1.el9_7.x86_64 2026-03-07T01:33:47.243 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:47.243 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:33:47.284 INFO:teuthology.packaging:Installing package postgresql-server on ubuntu@vm07.local 2026-03-07T01:33:47.284 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y install postgresql-server 2026-03-07T01:33:47.675 INFO:teuthology.orchestra.run.vm07.stdout:Last metadata expiration check: 0:02:08 ago on Sat 07 Mar 2026 01:31:39 AM CET. 2026-03-07T01:33:47.766 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:33:47.766 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:47.766 INFO:teuthology.orchestra.run.vm07.stdout: Package Architecture Version Repository Size 2026-03-07T01:33:47.766 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:47.766 INFO:teuthology.orchestra.run.vm07.stdout:Installing: 2026-03-07T01:33:47.766 INFO:teuthology.orchestra.run.vm07.stdout: postgresql-server x86_64 13.23-1.el9_7 appstream 5.7 M 2026-03-07T01:33:47.766 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:47.766 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:33:47.766 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:33:47.766 INFO:teuthology.orchestra.run.vm07.stdout:Install 1 Package 2026-03-07T01:33:47.766 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:47.766 INFO:teuthology.orchestra.run.vm07.stdout:Total download size: 5.7 M 2026-03-07T01:33:47.766 INFO:teuthology.orchestra.run.vm07.stdout:Installed size: 23 M 2026-03-07T01:33:47.766 INFO:teuthology.orchestra.run.vm07.stdout:Downloading Packages: 2026-03-07T01:33:49.324 INFO:teuthology.orchestra.run.vm07.stdout:postgresql-server-13.23-1.el9_7.x86_64.rpm 4.1 MB/s | 5.7 MB 00:01 2026-03-07T01:33:49.325 INFO:teuthology.orchestra.run.vm07.stdout:-------------------------------------------------------------------------------- 2026-03-07T01:33:49.325 INFO:teuthology.orchestra.run.vm07.stdout:Total 3.7 MB/s | 5.7 MB 00:01 2026-03-07T01:33:49.351 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:33:49.359 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:33:49.359 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:33:49.405 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:33:49.405 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:33:49.470 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:33:49.616 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: postgresql-server-13.23-1.el9_7.x86_64 1/1 2026-03-07T01:33:49.624 INFO:teuthology.orchestra.run.vm07.stdout: Installing : postgresql-server-13.23-1.el9_7.x86_64 1/1 2026-03-07T01:33:50.082 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: postgresql-server-13.23-1.el9_7.x86_64 1/1 2026-03-07T01:33:50.141 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : postgresql-server-13.23-1.el9_7.x86_64 1/1 2026-03-07T01:33:50.141 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:50.141 INFO:teuthology.orchestra.run.vm07.stdout:Installed: 2026-03-07T01:33:50.141 INFO:teuthology.orchestra.run.vm07.stdout: postgresql-server-13.23-1.el9_7.x86_64 2026-03-07T01:33:50.141 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:33:50.141 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:33:50.178 INFO:tasks.keystone:Setting up database for keystone... 2026-03-07T01:33:50.178 DEBUG:teuthology.orchestra.run.vm07:> sudo systemctl restart mariadb 2026-03-07T01:33:51.877 DEBUG:teuthology.orchestra.run.vm07:> sudo mysql --execute="CREATE USER 'keystone'@'localhost' IDENTIFIED BY 'SECRET';" 2026-03-07T01:33:51.909 DEBUG:teuthology.orchestra.run.vm07:> sudo mysql --execute="CREATE DATABASE keystone;" 2026-03-07T01:33:51.984 DEBUG:teuthology.orchestra.run.vm07:> sudo mysql --execute="GRANT ALL PRIVILEGES ON keystone.* TO 'keystone'@'localhost';" 2026-03-07T01:33:52.057 DEBUG:teuthology.orchestra.run.vm07:> sudo mysql --execute="FLUSH PRIVILEGES;" 2026-03-07T01:33:52.132 INFO:tasks.keystone:Setting up virtualenv for keystone... 2026-03-07T01:33:52.132 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && sed -i 's/usedevelop.*/usedevelop=false/g' tox.ini 2026-03-07T01:33:52.191 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && source /home/ubuntu/cephtest/tox-venv/bin/activate && tox -e venv --notest 2026-03-07T01:33:52.325 INFO:teuthology.orchestra.run.vm07.stdout:.tox create: /home/ubuntu/cephtest/keystone/.tox/.tox 2026-03-07T01:33:52.720 INFO:teuthology.orchestra.run.vm07.stdout:.tox installdeps: tox >= 3.18.0 2026-03-07T01:33:57.129 INFO:teuthology.orchestra.run.vm07.stdout:venv: install_deps> python -I -m pip install '.[ldap,memcache]' -r /home/ubuntu/cephtest/keystone/test-requirements.txt -c https://releases.openstack.org/constraints/upper/2025.1 2026-03-07T01:34:25.589 INFO:teuthology.orchestra.run.vm07.stdout:.pkg: install_requires> python -I -m pip install 'setuptools>=40.8.0' 2026-03-07T01:34:26.032 INFO:teuthology.orchestra.run.vm07.stdout:.pkg: _optional_hooks> python /home/ubuntu/cephtest/keystone/.tox/.tox/lib/python3.9/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-03-07T01:34:26.219 INFO:teuthology.orchestra.run.vm07.stdout:.pkg: get_requires_for_build_sdist> python /home/ubuntu/cephtest/keystone/.tox/.tox/lib/python3.9/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-03-07T01:34:26.321 INFO:teuthology.orchestra.run.vm07.stdout:.pkg: install_requires_for_build_sdist> python -I -m pip install 'pbr>=2.0.0' 2026-03-07T01:34:26.690 INFO:teuthology.orchestra.run.vm07.stdout:.pkg: get_requires_for_build_wheel> python /home/ubuntu/cephtest/keystone/.tox/.tox/lib/python3.9/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-03-07T01:34:26.794 INFO:teuthology.orchestra.run.vm07.stdout:.pkg: install_requires_for_build_wheel> python -I -m pip install 'pbr>=2.0.0' 2026-03-07T01:34:26.984 INFO:teuthology.orchestra.run.vm07.stdout:.pkg: prepare_metadata_for_build_wheel> python /home/ubuntu/cephtest/keystone/.tox/.tox/lib/python3.9/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-03-07T01:34:27.629 INFO:teuthology.orchestra.run.vm07.stdout:.pkg: build_sdist> python /home/ubuntu/cephtest/keystone/.tox/.tox/lib/python3.9/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-03-07T01:34:29.344 INFO:teuthology.orchestra.run.vm07.stdout:venv: install_package_deps> python -I -m pip install 'Flask!=0.11,>=1.0.2' 'Flask-RESTful>=0.3.5' 'PyJWT>=1.6.1' 'SQLAlchemy>=1.4.0' 'WebOb>=1.7.1' 'bcrypt>=3.1.3' 'cryptography>=2.7' 'dogpile.cache>=1.0.2' 'jsonschema>=3.2.0' 'keystonemiddleware>=7.0.0' 'msgpack>=0.5.0' 'oauthlib>=0.6.2' 'oslo.cache>=1.26.0' 'oslo.config>=6.8.0' 'oslo.context>=2.22.0' 'oslo.db>=6.0.0' 'oslo.i18n>=3.15.3' 'oslo.log>=3.44.0' 'oslo.messaging>=5.29.0' 'oslo.middleware>=3.31.0' 'oslo.policy>=4.5.0' 'oslo.serialization!=2.19.1,>=2.18.0' 'oslo.upgradecheck>=1.3.0' 'oslo.utils>=3.33.0' 'osprofiler>=1.4.0' 'pbr!=2.1.0,>=2.0.0' 'pycadf!=2.0.0,>=1.1.0' 'pysaml2>=5.0.0' 'python-keystoneclient>=3.8.0' 'scrypt>=0.8.0' 'stevedore>=1.20.0' 2026-03-07T01:34:29.769 INFO:teuthology.orchestra.run.vm07.stdout:venv: install_package> python -I -m pip install --force-reinstall --no-deps /home/ubuntu/cephtest/keystone/.tox/.tmp/package/1/keystone-27.0.1.dev26.tar.gz 2026-03-07T01:34:32.904 INFO:teuthology.orchestra.run.vm07.stdout: venv: OK (37.29 seconds) 2026-03-07T01:34:32.904 INFO:teuthology.orchestra.run.vm07.stdout: congratulations :) (37.31 seconds) 2026-03-07T01:34:32.954 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && pip install python-openstackclient uwsgi 2026-03-07T01:34:33.190 INFO:teuthology.orchestra.run.vm07.stdout:Collecting python-openstackclient 2026-03-07T01:34:33.219 INFO:teuthology.orchestra.run.vm07.stdout: Downloading python_openstackclient-8.0.0-py3-none-any.whl.metadata (6.4 kB) 2026-03-07T01:34:33.235 INFO:teuthology.orchestra.run.vm07.stdout:Collecting uwsgi 2026-03-07T01:34:33.244 INFO:teuthology.orchestra.run.vm07.stdout: Downloading uwsgi-2.0.31.tar.gz (822 kB) 2026-03-07T01:34:33.284 INFO:teuthology.orchestra.run.vm07.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 822.8/822.8 kB 37.7 MB/s 0:00:00 2026-03-07T01:34:33.412 INFO:teuthology.orchestra.run.vm07.stdout: Installing build dependencies: started 2026-03-07T01:34:33.884 INFO:teuthology.orchestra.run.vm07.stdout: Installing build dependencies: finished with status 'done' 2026-03-07T01:34:33.884 INFO:teuthology.orchestra.run.vm07.stdout: Getting requirements to build wheel: started 2026-03-07T01:34:34.087 INFO:teuthology.orchestra.run.vm07.stdout: Getting requirements to build wheel: finished with status 'done' 2026-03-07T01:34:34.088 INFO:teuthology.orchestra.run.vm07.stdout: Preparing metadata (pyproject.toml): started 2026-03-07T01:34:34.194 INFO:teuthology.orchestra.run.vm07.stdout: Preparing metadata (pyproject.toml): finished with status 'done' 2026-03-07T01:34:34.196 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: pbr!=2.1.0,>=2.0.0 in ./.tox/venv/lib/python3.9/site-packages (from python-openstackclient) (6.1.1) 2026-03-07T01:34:34.196 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: cryptography>=2.7 in ./.tox/venv/lib64/python3.9/site-packages (from python-openstackclient) (43.0.3) 2026-03-07T01:34:34.196 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: cliff>=3.5.0 in ./.tox/venv/lib/python3.9/site-packages (from python-openstackclient) (4.9.1) 2026-03-07T01:34:34.197 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: iso8601>=0.1.11 in ./.tox/venv/lib/python3.9/site-packages (from python-openstackclient) (2.1.0) 2026-03-07T01:34:34.221 INFO:teuthology.orchestra.run.vm07.stdout:Collecting openstacksdk>=3.3.0 (from python-openstackclient) 2026-03-07T01:34:34.230 INFO:teuthology.orchestra.run.vm07.stdout: Downloading openstacksdk-4.5.0-py3-none-any.whl.metadata (12 kB) 2026-03-07T01:34:34.250 INFO:teuthology.orchestra.run.vm07.stdout:Collecting osc-lib>=2.3.0 (from python-openstackclient) 2026-03-07T01:34:34.259 INFO:teuthology.orchestra.run.vm07.stdout: Downloading osc_lib-4.0.2-py3-none-any.whl.metadata (3.6 kB) 2026-03-07T01:34:34.262 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: oslo.i18n>=3.15.3 in ./.tox/venv/lib/python3.9/site-packages (from python-openstackclient) (6.5.1) 2026-03-07T01:34:34.262 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: python-keystoneclient>=3.22.0 in ./.tox/venv/lib/python3.9/site-packages (from python-openstackclient) (5.6.0) 2026-03-07T01:34:34.281 INFO:teuthology.orchestra.run.vm07.stdout:Collecting python-cinderclient>=3.3.0 (from python-openstackclient) 2026-03-07T01:34:34.291 INFO:teuthology.orchestra.run.vm07.stdout: Downloading python_cinderclient-9.7.0-py3-none-any.whl.metadata (19 kB) 2026-03-07T01:34:34.294 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: requests>=2.27.0 in ./.tox/venv/lib/python3.9/site-packages (from python-openstackclient) (2.32.3) 2026-03-07T01:34:34.294 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: stevedore>=2.0.1 in ./.tox/venv/lib/python3.9/site-packages (from python-openstackclient) (5.4.1) 2026-03-07T01:34:34.295 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: autopage>=0.4.0 in ./.tox/venv/lib/python3.9/site-packages (from cliff>=3.5.0->python-openstackclient) (0.5.2) 2026-03-07T01:34:34.295 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: cmd2>=1.0.0 in ./.tox/venv/lib/python3.9/site-packages (from cliff>=3.5.0->python-openstackclient) (2.5.11) 2026-03-07T01:34:34.296 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: PrettyTable>=0.7.2 in ./.tox/venv/lib/python3.9/site-packages (from cliff>=3.5.0->python-openstackclient) (3.14.0) 2026-03-07T01:34:34.296 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: PyYAML>=3.12 in ./.tox/venv/lib64/python3.9/site-packages (from cliff>=3.5.0->python-openstackclient) (6.0.2) 2026-03-07T01:34:34.296 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: importlib-metadata>=4.4 in ./.tox/venv/lib/python3.9/site-packages (from cliff>=3.5.0->python-openstackclient) (6.2.1) 2026-03-07T01:34:34.297 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: pyperclip>=1.8 in ./.tox/venv/lib/python3.9/site-packages (from cmd2>=1.0.0->cliff>=3.5.0->python-openstackclient) (1.9.0) 2026-03-07T01:34:34.297 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: wcwidth>=0.2.10 in ./.tox/venv/lib/python3.9/site-packages (from cmd2>=1.0.0->cliff>=3.5.0->python-openstackclient) (0.2.13) 2026-03-07T01:34:34.300 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: cffi>=1.12 in ./.tox/venv/lib64/python3.9/site-packages (from cryptography>=2.7->python-openstackclient) (1.17.1) 2026-03-07T01:34:34.300 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: pycparser in ./.tox/venv/lib/python3.9/site-packages (from cffi>=1.12->cryptography>=2.7->python-openstackclient) (2.22) 2026-03-07T01:34:34.302 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: zipp>=0.5 in ./.tox/venv/lib/python3.9/site-packages (from importlib-metadata>=4.4->cliff>=3.5.0->python-openstackclient) (3.21.0) 2026-03-07T01:34:34.303 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: decorator>=4.4.1 in ./.tox/venv/lib/python3.9/site-packages (from openstacksdk>=3.3.0->python-openstackclient) (5.1.1) 2026-03-07T01:34:34.303 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: dogpile.cache>=0.6.5 in ./.tox/venv/lib/python3.9/site-packages (from openstacksdk>=3.3.0->python-openstackclient) (1.3.4) 2026-03-07T01:34:34.316 INFO:teuthology.orchestra.run.vm07.stdout:Collecting jmespath>=0.9.0 (from openstacksdk>=3.3.0->python-openstackclient) 2026-03-07T01:34:34.325 INFO:teuthology.orchestra.run.vm07.stdout: Downloading jmespath-1.1.0-py3-none-any.whl.metadata (7.6 kB) 2026-03-07T01:34:34.340 INFO:teuthology.orchestra.run.vm07.stdout:Collecting jsonpatch!=1.20,>=1.16 (from openstacksdk>=3.3.0->python-openstackclient) 2026-03-07T01:34:34.349 INFO:teuthology.orchestra.run.vm07.stdout: Downloading jsonpatch-1.33-py2.py3-none-any.whl.metadata (3.0 kB) 2026-03-07T01:34:34.351 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: keystoneauth1>=5.10.0 in ./.tox/venv/lib/python3.9/site-packages (from openstacksdk>=3.3.0->python-openstackclient) (5.10.0) 2026-03-07T01:34:34.352 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: os-service-types>=1.7.0 in ./.tox/venv/lib/python3.9/site-packages (from openstacksdk>=3.3.0->python-openstackclient) (1.7.0) 2026-03-07T01:34:34.394 INFO:teuthology.orchestra.run.vm07.stdout:Collecting platformdirs>=3 (from openstacksdk>=3.3.0->python-openstackclient) 2026-03-07T01:34:34.395 INFO:teuthology.orchestra.run.vm07.stdout: Using cached platformdirs-4.4.0-py3-none-any.whl.metadata (12 kB) 2026-03-07T01:34:34.397 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: psutil>=3.2.2 in ./.tox/venv/lib64/python3.9/site-packages (from openstacksdk>=3.3.0->python-openstackclient) (7.0.0) 2026-03-07T01:34:34.414 INFO:teuthology.orchestra.run.vm07.stdout:Collecting requestsexceptions>=1.2.0 (from openstacksdk>=3.3.0->python-openstackclient) 2026-03-07T01:34:34.423 INFO:teuthology.orchestra.run.vm07.stdout: Downloading requestsexceptions-1.4.0-py2.py3-none-any.whl.metadata (1.2 kB) 2026-03-07T01:34:34.425 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: typing-extensions>=4.12.0 in ./.tox/venv/lib/python3.9/site-packages (from openstacksdk>=3.3.0->python-openstackclient) (4.12.2) 2026-03-07T01:34:34.441 INFO:teuthology.orchestra.run.vm07.stdout:Collecting jsonpointer>=1.9 (from jsonpatch!=1.20,>=1.16->openstacksdk>=3.3.0->python-openstackclient) 2026-03-07T01:34:34.451 INFO:teuthology.orchestra.run.vm07.stdout: Downloading jsonpointer-3.0.0-py2.py3-none-any.whl.metadata (2.3 kB) 2026-03-07T01:34:34.463 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: oslo.utils>=3.33.0 in ./.tox/venv/lib/python3.9/site-packages (from osc-lib>=2.3.0->python-openstackclient) (8.2.0) 2026-03-07T01:34:34.465 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: netaddr>=0.10.0 in ./.tox/venv/lib/python3.9/site-packages (from oslo.utils>=3.33.0->osc-lib>=2.3.0->python-openstackclient) (1.3.0) 2026-03-07T01:34:34.465 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: debtcollector>=1.2.0 in ./.tox/venv/lib/python3.9/site-packages (from oslo.utils>=3.33.0->osc-lib>=2.3.0->python-openstackclient) (3.0.0) 2026-03-07T01:34:34.465 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: pyparsing>=2.1.0 in ./.tox/venv/lib/python3.9/site-packages (from oslo.utils>=3.33.0->osc-lib>=2.3.0->python-openstackclient) (3.2.1) 2026-03-07T01:34:34.465 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: packaging>=20.4 in ./.tox/venv/lib/python3.9/site-packages (from oslo.utils>=3.33.0->osc-lib>=2.3.0->python-openstackclient) (24.2) 2026-03-07T01:34:34.466 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: tzdata>=2022.4 in ./.tox/venv/lib/python3.9/site-packages (from oslo.utils>=3.33.0->osc-lib>=2.3.0->python-openstackclient) (2025.1) 2026-03-07T01:34:34.467 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: wrapt>=1.7.0 in ./.tox/venv/lib64/python3.9/site-packages (from debtcollector>=1.2.0->oslo.utils>=3.33.0->osc-lib>=2.3.0->python-openstackclient) (1.17.2) 2026-03-07T01:34:34.468 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: setuptools in ./.tox/venv/lib/python3.9/site-packages (from pbr!=2.1.0,>=2.0.0->python-openstackclient) (82.0.0) 2026-03-07T01:34:34.474 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: oslo.config>=5.2.0 in ./.tox/venv/lib/python3.9/site-packages (from python-keystoneclient>=3.22.0->python-openstackclient) (9.7.1) 2026-03-07T01:34:34.475 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: oslo.serialization>=2.18.0 in ./.tox/venv/lib/python3.9/site-packages (from python-keystoneclient>=3.22.0->python-openstackclient) (5.7.0) 2026-03-07T01:34:34.477 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: rfc3986>=1.2.0 in ./.tox/venv/lib/python3.9/site-packages (from oslo.config>=5.2.0->python-keystoneclient>=3.22.0->python-openstackclient) (2.0.0) 2026-03-07T01:34:34.478 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: msgpack>=0.5.2 in ./.tox/venv/lib64/python3.9/site-packages (from oslo.serialization>=2.18.0->python-keystoneclient>=3.22.0->python-openstackclient) (1.1.0) 2026-03-07T01:34:34.480 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: charset-normalizer<4,>=2 in ./.tox/venv/lib64/python3.9/site-packages (from requests>=2.27.0->python-openstackclient) (3.4.1) 2026-03-07T01:34:34.481 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: idna<4,>=2.5 in ./.tox/venv/lib/python3.9/site-packages (from requests>=2.27.0->python-openstackclient) (3.10) 2026-03-07T01:34:34.481 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: urllib3<3,>=1.21.1 in ./.tox/venv/lib/python3.9/site-packages (from requests>=2.27.0->python-openstackclient) (1.26.20) 2026-03-07T01:34:34.481 INFO:teuthology.orchestra.run.vm07.stdout:Requirement already satisfied: certifi>=2017.4.17 in ./.tox/venv/lib/python3.9/site-packages (from requests>=2.27.0->python-openstackclient) (2026.2.25) 2026-03-07T01:34:34.509 INFO:teuthology.orchestra.run.vm07.stdout:Downloading python_openstackclient-8.0.0-py3-none-any.whl (1.1 MB) 2026-03-07T01:34:34.523 INFO:teuthology.orchestra.run.vm07.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 69.1 MB/s 0:00:00 2026-03-07T01:34:34.532 INFO:teuthology.orchestra.run.vm07.stdout:Downloading openstacksdk-4.5.0-py3-none-any.whl (1.8 MB) 2026-03-07T01:34:34.560 INFO:teuthology.orchestra.run.vm07.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 64.8 MB/s 0:00:00 2026-03-07T01:34:34.568 INFO:teuthology.orchestra.run.vm07.stdout:Downloading jmespath-1.1.0-py3-none-any.whl (20 kB) 2026-03-07T01:34:34.579 INFO:teuthology.orchestra.run.vm07.stdout:Downloading jsonpatch-1.33-py2.py3-none-any.whl (12 kB) 2026-03-07T01:34:34.590 INFO:teuthology.orchestra.run.vm07.stdout:Downloading jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB) 2026-03-07T01:34:34.600 INFO:teuthology.orchestra.run.vm07.stdout:Downloading osc_lib-4.0.2-py3-none-any.whl (93 kB) 2026-03-07T01:34:34.604 INFO:teuthology.orchestra.run.vm07.stdout:Using cached platformdirs-4.4.0-py3-none-any.whl (18 kB) 2026-03-07T01:34:34.613 INFO:teuthology.orchestra.run.vm07.stdout:Downloading python_cinderclient-9.7.0-py3-none-any.whl (256 kB) 2026-03-07T01:34:34.627 INFO:teuthology.orchestra.run.vm07.stdout:Downloading requestsexceptions-1.4.0-py2.py3-none-any.whl (3.8 kB) 2026-03-07T01:34:34.643 INFO:teuthology.orchestra.run.vm07.stdout:Building wheels for collected packages: uwsgi 2026-03-07T01:34:34.644 INFO:teuthology.orchestra.run.vm07.stdout: Building wheel for uwsgi (pyproject.toml): started 2026-03-07T01:34:43.261 INFO:teuthology.orchestra.run.vm07.stdout: Building wheel for uwsgi (pyproject.toml): finished with status 'done' 2026-03-07T01:34:43.262 INFO:teuthology.orchestra.run.vm07.stdout: Created wheel for uwsgi: filename=uwsgi-2.0.31-cp39-cp39-linux_x86_64.whl size=516068 sha256=bf6fb740e6ea9916d23028b57b1ea73fa6d7c6ab9d70d37667fe3c65e90da71d 2026-03-07T01:34:43.262 INFO:teuthology.orchestra.run.vm07.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/24/a5/03/5bd0ede15052bfde03cfa27de7101a4f3648fb7e726d1e9092 2026-03-07T01:34:43.264 INFO:teuthology.orchestra.run.vm07.stdout:Successfully built uwsgi 2026-03-07T01:34:43.341 INFO:teuthology.orchestra.run.vm07.stdout:Installing collected packages: uwsgi, requestsexceptions, platformdirs, jsonpointer, jmespath, jsonpatch, python-cinderclient, openstacksdk, osc-lib, python-openstackclient 2026-03-07T01:34:44.564 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:34:44.570 INFO:teuthology.orchestra.run.vm07.stdout:Successfully installed jmespath-1.1.0 jsonpatch-1.33 jsonpointer-3.0.0 openstacksdk-4.5.0 osc-lib-4.0.2 platformdirs-4.4.0 python-cinderclient-9.7.0 python-openstackclient-8.0.0 requestsexceptions-1.4.0 uwsgi-2.0.31 2026-03-07T01:34:44.728 INFO:tasks.keystone:Configuring keystone... 2026-03-07T01:34:44.728 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && source /home/ubuntu/cephtest/tox-venv/bin/activate && tox -e genconfig 2026-03-07T01:34:46.159 INFO:teuthology.orchestra.run.vm07.stdout:genconfig: install_deps> python -I -m pip install '.[ldap,memcache]' -r /home/ubuntu/cephtest/keystone/test-requirements.txt -c https://releases.openstack.org/constraints/upper/2025.1 2026-03-07T01:35:02.152 INFO:teuthology.orchestra.run.vm07.stdout:.pkg: _optional_hooks> python /home/ubuntu/cephtest/keystone/.tox/.tox/lib/python3.9/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-03-07T01:35:02.283 INFO:teuthology.orchestra.run.vm07.stdout:.pkg: get_requires_for_build_sdist> python /home/ubuntu/cephtest/keystone/.tox/.tox/lib/python3.9/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-03-07T01:35:02.388 INFO:teuthology.orchestra.run.vm07.stdout:.pkg: get_requires_for_build_wheel> python /home/ubuntu/cephtest/keystone/.tox/.tox/lib/python3.9/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-03-07T01:35:02.492 INFO:teuthology.orchestra.run.vm07.stdout:.pkg: prepare_metadata_for_build_wheel> python /home/ubuntu/cephtest/keystone/.tox/.tox/lib/python3.9/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-03-07T01:35:03.399 INFO:teuthology.orchestra.run.vm07.stdout:.pkg: build_sdist> python /home/ubuntu/cephtest/keystone/.tox/.tox/lib/python3.9/site-packages/pyproject_api/_backend.py True setuptools.build_meta __legacy__ 2026-03-07T01:35:05.390 INFO:teuthology.orchestra.run.vm07.stdout:genconfig: install_package_deps> python -I -m pip install 'Flask!=0.11,>=1.0.2' 'Flask-RESTful>=0.3.5' 'PyJWT>=1.6.1' 'SQLAlchemy>=1.4.0' 'WebOb>=1.7.1' 'bcrypt>=3.1.3' 'cryptography>=2.7' 'dogpile.cache>=1.0.2' 'jsonschema>=3.2.0' 'keystonemiddleware>=7.0.0' 'msgpack>=0.5.0' 'oauthlib>=0.6.2' 'oslo.cache>=1.26.0' 'oslo.config>=6.8.0' 'oslo.context>=2.22.0' 'oslo.db>=6.0.0' 'oslo.i18n>=3.15.3' 'oslo.log>=3.44.0' 'oslo.messaging>=5.29.0' 'oslo.middleware>=3.31.0' 'oslo.policy>=4.5.0' 'oslo.serialization!=2.19.1,>=2.18.0' 'oslo.upgradecheck>=1.3.0' 'oslo.utils>=3.33.0' 'osprofiler>=1.4.0' 'pbr!=2.1.0,>=2.0.0' 'pycadf!=2.0.0,>=1.1.0' 'pysaml2>=5.0.0' 'python-keystoneclient>=3.8.0' 'scrypt>=0.8.0' 'stevedore>=1.20.0' 2026-03-07T01:35:05.803 INFO:teuthology.orchestra.run.vm07.stdout:genconfig: install_package> python -I -m pip install --force-reinstall --no-deps /home/ubuntu/cephtest/keystone/.tox/.tmp/package/2/keystone-27.0.1.dev26.tar.gz 2026-03-07T01:35:09.248 INFO:teuthology.orchestra.run.vm07.stdout:genconfig: commands[0]> oslo-config-generator --config-file=config-generator/keystone.conf 2026-03-07T01:35:09.665 INFO:teuthology.orchestra.run.vm07.stdout: genconfig: OK (24.68=setup[24.26]+cmd[0.42] seconds) 2026-03-07T01:35:09.665 INFO:teuthology.orchestra.run.vm07.stdout: congratulations :) (24.70 seconds) 2026-03-07T01:35:09.717 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && cp -f etc/keystone.conf.sample etc/keystone.conf 2026-03-07T01:35:09.734 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && sed -e 's^#key_repository =.*^key_repository = /home/ubuntu/cephtest/keystone/etc/fernet-keys^' -i etc/keystone.conf 2026-03-07T01:35:09.796 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && sed -e 's^#connection =.*^connection = mysql+pymysql://keystone:SECRET@localhost/keystone^' -i etc/keystone.conf 2026-03-07T01:35:09.855 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && sed -e 's^#log_file =.*^log_file = /home/ubuntu/cephtest/archive/keystone.client.0.log^' -i etc/keystone.conf 2026-03-07T01:35:09.914 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && cp etc/keystone.conf /home/ubuntu/cephtest/archive/keystone.client.0.conf 2026-03-07T01:35:09.973 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && mkdir -p /home/ubuntu/cephtest/keystone/etc/fernet-keys 2026-03-07T01:35:10.032 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && keystone-manage --config-file /home/ubuntu/cephtest/keystone/etc/keystone.conf fernet_setup 2026-03-07T01:35:11.201 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && keystone-manage --config-file /home/ubuntu/cephtest/keystone/etc/keystone.conf db_sync 2026-03-07T01:35:13.856 INFO:tasks.keystone:Configuring keystone... 2026-03-07T01:35:13.856 INFO:tasks.keystone.client.0:Restarting daemon 2026-03-07T01:35:13.856 DEBUG:teuthology.orchestra.run.vm07:> OS_KEYSTONE_CONFIG_FILES=/home/ubuntu/cephtest/keystone/etc/keystone.conf /home/ubuntu/cephtest/keystone/.tox/venv/bin/uwsgi --http-socket vm07.local:5000 --module keystone.wsgi.api:application & { read; kill %1; } 2026-03-07T01:35:13.858 INFO:tasks.keystone.client.0:Started 2026-03-07T01:35:13.858 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && sleep 15 2026-03-07T01:35:13.876 INFO:tasks.keystone.client.0.vm07.stderr:*** Starting uWSGI 2.0.31 (64bit) on [Sat Mar 7 01:35:13 2026] *** 2026-03-07T01:35:13.876 INFO:tasks.keystone.client.0.vm07.stderr:compiled with version: 11.5.0 20240719 (Red Hat 11.5.0-11) on 07 March 2026 00:34:34 2026-03-07T01:35:13.876 INFO:tasks.keystone.client.0.vm07.stderr:os: Linux-5.14.0-611.5.1.el9_7.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 11 22:20:27 UTC 2025 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:nodename: vm07.local 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:machine: x86_64 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:clock source: unix 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:detected number of CPU cores: 2 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:current working directory: /home/ubuntu 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:detected binary path: /home/ubuntu/cephtest/keystone/.tox/venv/bin/uwsgi 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:!!! no internal routing support, rebuild with pcre support !!! 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:*** WARNING: you are running uWSGI without its master process manager *** 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:your processes number limit is 30399 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:your memory page size is 4096 bytes 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:detected max file descriptor number: 1024 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:lock engine: pthread robust mutexes 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:thunder lock: disabled (you can enable it with --thunder-lock) 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:uwsgi socket 0 bound to TCP address vm07.local:5000 fd 3 2026-03-07T01:35:13.877 INFO:tasks.keystone.client.0.vm07.stderr:Python version: 3.9.23 (main, Aug 19 2025, 00:00:00) [GCC 11.5.0 20240719 (Red Hat 11.5.0-11)] 2026-03-07T01:35:13.888 INFO:tasks.keystone.client.0.vm07.stderr:Python main interpreter initialized at 0x1b70270 2026-03-07T01:35:13.888 INFO:tasks.keystone.client.0.vm07.stderr:python threads support enabled 2026-03-07T01:35:13.889 INFO:tasks.keystone.client.0.vm07.stderr:your server socket listen backlog is limited to 100 connections 2026-03-07T01:35:13.889 INFO:tasks.keystone.client.0.vm07.stderr:your mercy for graceful operations on workers is 60 seconds 2026-03-07T01:35:13.889 INFO:tasks.keystone.client.0.vm07.stderr:mapped 72920 bytes (71 KB) for 1 cores 2026-03-07T01:35:13.889 INFO:tasks.keystone.client.0.vm07.stderr:*** Operational MODE: single process *** 2026-03-07T01:35:14.939 INFO:tasks.keystone.client.0.vm07.stderr:WSGI app 0 (mountpoint='') ready in 1 seconds on interpreter 0x1b70270 pid: 87024 (default app) 2026-03-07T01:35:14.939 INFO:tasks.keystone.client.0.vm07.stderr:*** uWSGI is running in multiple interpreter mode *** 2026-03-07T01:35:14.939 INFO:tasks.keystone.client.0.vm07.stderr:spawned uWSGI worker 1 (and the only) (pid: 87024, cores: 1) 2026-03-07T01:35:28.878 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && keystone-manage --config-file /home/ubuntu/cephtest/keystone/etc/keystone.conf bootstrap --bootstrap-password ADMIN --bootstrap-region-id RegionOne --bootstrap-internal-url http://vm07.local:5000/v3 --bootstrap-admin-url http://vm07.local:5000/v3 --bootstrap-public-url http://vm07.local:5000/v3 2026-03-07T01:35:30.494 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack project create --or-show --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://vm07.local:5000/v3 --description 's3tests project' s3tests --debug 2026-03-07T01:35:30.858 INFO:teuthology.orchestra.run.vm07.stderr:START with options: project create --or-show --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://vm07.local:5000/v3 --description s3tests project s3tests --debug 2026-03-07T01:35:30.859 INFO:teuthology.orchestra.run.vm07.stderr:options: Namespace(verbose_level=3, log_file=None, deferred_help=False, debug=True, cloud=None, region_name=None, cacert=None, cert=None, key=None, verify=None, insecure=None, default_domain='default', interface=None, service_provider=None, remote_project_name=None, remote_project_id=None, remote_project_domain_name=None, remote_project_domain_id=None, timing=False, os_beta_command=False, profile=None, os_compute_api_version=None, os_identity_api_version='3', os_image_api_version=None, os_network_api_version=None, os_object_api_version=None, os_volume_api_version=None, auth_type=None, auth_url='http://vm07.local:5000/v3', system_scope=None, domain_id=None, domain_name=None, project_id=None, project_name='admin', project_domain_id='default', project_domain_name=None, trust_id=None, user_id=None, username='admin', user_domain_id='default', user_domain_name=None, application_credential_secret=*** application_credential_id=None, application_credential_name=None, oauth2_endpoint=None, oauth2_client_id=None, endpoint=None, token=*** password='***', identity_provider=None, protocol=None, client_id=None, client_secret=*** openid_scope=None, access_token_endpoint=None, discovery_endpoint=None, access_token_type=None, idp_otp_key=None, oauth2_client_secret=*** redirect_uri=None, code=None, default_domain_id=None, default_domain_name=None, consumer_key=None, consumer_secret=*** access_key=None, access_secret=*** device_authorization_endpoint=None, code_challenge_method=None, identity_provider_url=None, access_token=*** auth_methods=None, service_provider_endpoint=None, service_provider_entity_id=None, passcode=None, os_project_name=None, os_project_id=None) 2026-03-07T01:35:30.859 INFO:teuthology.orchestra.run.vm07.stderr:Auth plugin password selected 2026-03-07T01:35:30.860 INFO:teuthology.orchestra.run.vm07.stderr:auth_config_hook(): {'api_timeout': None, 'verify': True, 'cacert': None, 'cert': None, 'key': None, 'baremetal_status_code_retries': '5', 'baremetal_introspection_status_code_retries': '5', 'image_status_code_retries': '5', 'disable_vendor_agent': {}, 'interface': 'public', 'floating_ip_source': 'neutron', 'image_api_use_tasks': False, 'image_format': 'qcow2', 'message': '', 'network_api_version': '2', 'object_store_api_version': '1', 'secgroup_source': 'neutron', 'status': 'active', 'auth': {'user_domain_id': 'default', 'project_domain_id': 'default', 'project_name': 'admin'}, 'verbose_level': 3, 'deferred_help': False, 'debug': True, 'default_domain': 'default', 'timing': False, 'auth_url': 'http://vm07.local:5000/v3', 'username': 'admin', 'password': '***', 'beta_command': False, 'identity_api_version': '3', 'region_name': '', 'auth_type': 'password', ': []} 2026-03-07T01:35:30.860 INFO:teuthology.orchestra.run.vm07.stderr:defaults: {'api_timeout': None, 'verify': True, 'cacert': None, 'cert': None, 'key': None, 'auth_type': 'password', 'baremetal_status_code_retries': 5, 'baremetal_introspection_status_code_retries': 5, 'image_status_code_retries': 5, 'disable_vendor_agent': {}, 'interface': 'public', 'floating_ip_source': 'neutron', 'image_api_use_tasks': False, 'image_format': 'qcow2', 'message': '', 'network_api_version': '2', 'object_store_api_version': '1', 'secgroup_source': 'neutron', 'status': 'active'} 2026-03-07T01:35:30.860 INFO:teuthology.orchestra.run.vm07.stderr:cloud cfg: {'api_timeout': None, 'verify': True, 'cacert': None, 'cert': None, 'key': None, 'baremetal_status_code_retries': '5', 'baremetal_introspection_status_code_retries': '5', 'image_status_code_retries': '5', 'disable_vendor_agent': {}, 'interface': 'public', 'floating_ip_source': 'neutron', 'image_api_use_tasks': False, 'image_format': 'qcow2', 'message': '', 'network_api_version': '2', 'object_store_api_version': '1', 'secgroup_source': 'neutron', 'status': 'active', 'auth': {'user_domain_id': 'default', 'project_domain_id': 'default', 'project_name': 'admin'}, 'verbose_level': 3, 'deferred_help': False, 'debug': True, 'default_domain': 'default', 'timing': False, 'auth_url': 'http://vm07.local:5000/v3', 'username': 'admin', 'password': '***', 'beta_command': False, 'identity_api_version': '3', 'region_name': '', 'auth_type': 'password', ': []} 2026-03-07T01:35:30.869 INFO:teuthology.orchestra.run.vm07.stderr:compute API version 2.1, cmd group openstack.compute.v2 2026-03-07T01:35:30.874 INFO:teuthology.orchestra.run.vm07.stderr:identity API version 3, cmd group openstack.identity.v3 2026-03-07T01:35:30.876 INFO:teuthology.orchestra.run.vm07.stderr:image API version 2, cmd group openstack.image.v2 2026-03-07T01:35:30.883 INFO:teuthology.orchestra.run.vm07.stderr:network API version 2, cmd group openstack.network.v2 2026-03-07T01:35:30.884 INFO:teuthology.orchestra.run.vm07.stderr:object_store API version 1, cmd group openstack.object_store.v1 2026-03-07T01:35:30.889 INFO:teuthology.orchestra.run.vm07.stderr:volume API version 3, cmd group openstack.volume.v3 2026-03-07T01:35:30.921 INFO:teuthology.orchestra.run.vm07.stderr:command: project create -> openstackclient.identity.v3.project.CreateProject (auth=True) 2026-03-07T01:35:30.921 INFO:teuthology.orchestra.run.vm07.stderr:Auth plugin password selected 2026-03-07T01:35:30.921 INFO:teuthology.orchestra.run.vm07.stderr:auth_config_hook(): {'api_timeout': None, 'verify': True, 'cacert': None, 'cert': None, 'key': None, 'baremetal_status_code_retries': '5', 'baremetal_introspection_status_code_retries': '5', 'image_status_code_retries': '5', 'disable_vendor_agent': {}, 'interface': 'public', 'floating_ip_source': 'neutron', 'image_api_use_tasks': False, 'image_format': 'qcow2', 'message': '', 'network_api_version': '2', 'object_store_api_version': '1', 'secgroup_source': 'neutron', 'status': 'active', 'auth': {'user_domain_id': 'default', 'project_domain_id': 'default', 'project_name': 'admin'}, 'additional_user_agent': [('osc-lib', '4.0.2')], 'verbose_level': 3, 'deferred_help': False, 'debug': True, 'default_domain': 'default', 'timing': False, 'auth_url': 'http://vm07.local:5000/v3', 'username': 'admin', 'password': '***', 'beta_command': False, 'identity_api_version': '3', 'region_name': '', 'auth_type': 'password', ': []} 2026-03-07T01:35:30.922 INFO:teuthology.orchestra.run.vm07.stderr:Using auth plugin: password 2026-03-07T01:35:30.922 INFO:teuthology.orchestra.run.vm07.stderr:Using parameters {'auth_url': 'http://vm07.local:5000/v3', 'project_name': 'admin', 'project_domain_id': 'default', 'username': 'admin', 'user_domain_id': 'default', 'password': '***'} 2026-03-07T01:35:30.922 INFO:teuthology.orchestra.run.vm07.stderr:Get auth_ref 2026-03-07T01:35:30.922 INFO:teuthology.orchestra.run.vm07.stderr:REQ: curl -g -i -X GET http://vm07.local:5000/v3 -H "Accept: application/json" -H "User-Agent: openstacksdk/4.5.0 keystoneauth1/5.10.0 python-requests/2.32.3 CPython/3.9.23" 2026-03-07T01:35:30.923 INFO:teuthology.orchestra.run.vm07.stderr:Starting new HTTP connection (1): vm07.local:5000 2026-03-07T01:35:30.926 INFO:tasks.keystone.client.0.vm07.stderr:[pid: 87024|app: 0|req: 1/1] 192.168.123.107 () {28 vars in 408 bytes} [Sat Mar 7 01:35:30 2026] GET /v3 => generated 250 bytes in 1 msecs (HTTP/1.1 200) 4 headers in 158 bytes (1 switches on core 0) 2026-03-07T01:35:30.926 INFO:teuthology.orchestra.run.vm07.stderr:http://vm07.local:5000 "GET /v3 HTTP/1.1" 200 250 2026-03-07T01:35:30.926 INFO:teuthology.orchestra.run.vm07.stderr:RESP: [200] Content-Length: 250 Content-Type: application/json Vary: X-Auth-Token x-openstack-request-id: req-34fb3907-44c4-47c8-8b1b-9c061f325670 2026-03-07T01:35:30.926 INFO:teuthology.orchestra.run.vm07.stderr:RESP BODY: {"version": {"id": "v3.14", "status": "stable", "updated": "2020-04-07T00:00:00Z", "links": [{"rel": "self", "href": "http://vm07.local:5000/v3/"}], "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}]}} 2026-03-07T01:35:30.926 INFO:teuthology.orchestra.run.vm07.stderr:GET call to http://vm07.local:5000/v3 used request id req-34fb3907-44c4-47c8-8b1b-9c061f325670 2026-03-07T01:35:30.926 INFO:teuthology.orchestra.run.vm07.stderr:Making authentication request to http://vm07.local:5000/v3/auth/tokens 2026-03-07T01:35:30.927 INFO:teuthology.orchestra.run.vm07.stderr:Resetting dropped connection: vm07.local 2026-03-07T01:35:31.185 INFO:tasks.keystone.client.0.vm07.stderr:[pid: 87024|app: 0|req: 2/2] 192.168.123.107 () {32 vars in 486 bytes} [Sat Mar 7 01:35:30 2026] POST /v3/auth/tokens => generated 1280 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 366 bytes (2 switches on core 0) 2026-03-07T01:35:31.186 INFO:teuthology.orchestra.run.vm07.stderr:http://vm07.local:5000 "POST /v3/auth/tokens HTTP/1.1" 201 1280 2026-03-07T01:35:31.186 INFO:teuthology.orchestra.run.vm07.stderr:{"token": {"methods": ["password"], "user": {"domain": {"id": "default", "name": "Default"}, "id": "1318af88229947e39e31de57e332cde5", "name": "admin", "password_expires_at": null}, "audit_ids": ["IoN6y2niSeWbUu7gCAzBOA"], "expires_at": "2026-03-07T01:35:31.000000Z", "issued_at": "2026-03-07T00:35:31.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "8a03bff5b7964bdda8c0b9bef8d37413", "name": "admin"}, "is_domain": false, "roles": [{"id": "cc8aa6f909c04852930a13073463781e", "name": "member"}, {"id": "559ea700c2c84d77afabc40246e7716f", "name": "reader"}, {"id": "9ee7ef3c186d416c85867232b2b06050", "name": "admin"}, {"id": "2eb9bc1fda4d43c09e464beb572f447c", "name": "manager"}], "catalog": [{"endpoints": [{"id": "0df67301a86141f5a6ac5f6d699311ef", "interface": "internal", "region_id": "RegionOne", "url": "http://vm07.local:5000/v3", "region": "RegionOne"}, {"id": "2c2d61a8d59e49deb258deed7a7cd56c", "interface": "admin", "region_id": "RegionOne", "url": "http://vm07.local:5000/v3", "region": "RegionOne"}, {"id": "4dfdd0b07d0d4995abb9107a0fbc6d21", "interface": "public", "region_id": "RegionOne", "url": "http://vm07.local:5000/v3", "region": "RegionOne"}], "id": "a1563c9d56324b20bd20f2f21ab65409", "type": "identity", "name": "keystone"}]}} 2026-03-07T01:35:31.226 INFO:teuthology.orchestra.run.vm07.stderr:run(Namespace(formatter='table', columns=[], noindent=False, variables=[], prefix='', max_width=0, fit_width=False, print_empty=False, name='s3tests', domain=None, parent=None, description='s3tests project', enable=False, disable=False, property=None, or_show=True, immutable=False, no_immutable=False, tags=[])) 2026-03-07T01:35:31.226 INFO:teuthology.orchestra.run.vm07.stderr:Instantiating identity client: 2026-03-07T01:35:31.227 INFO:teuthology.orchestra.run.vm07.stderr:REQ: curl -g -i -X POST http://vm07.local:5000/v3/projects -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-keystoneclient" -H "X-Auth-Token: {SHA256}9f0c91218d0efde5059ca61c71b69e9a37a6aa8210649f45780af18b1c572b0c" -d '{"project": {"name": "s3tests", "description": "s3tests project", "enabled": true, "options": {}, "tags": []}}' 2026-03-07T01:35:31.227 INFO:teuthology.orchestra.run.vm07.stderr:Resetting dropped connection: vm07.local 2026-03-07T01:35:31.299 INFO:tasks.keystone.client.0.vm07.stderr:[pid: 87024|app: 0|req: 3/3] 192.168.123.107 () {34 vars in 628 bytes} [Sat Mar 7 01:35:31 2026] POST /v3/projects => generated 311 bytes in 71 msecs (HTTP/1.1 201) 4 headers in 163 bytes (1 switches on core 0) 2026-03-07T01:35:31.300 INFO:teuthology.orchestra.run.vm07.stderr:http://vm07.local:5000 "POST /v3/projects HTTP/1.1" 201 311 2026-03-07T01:35:31.300 INFO:teuthology.orchestra.run.vm07.stderr:RESP: [201] Content-Length: 311 Content-Type: application/json Vary: X-Auth-Token x-openstack-request-id: req-74f0c88c-1a11-4eae-a963-b7ab22a48f96 2026-03-07T01:35:31.300 INFO:teuthology.orchestra.run.vm07.stderr:RESP BODY: {"project": {"id": "5280482d1440427e99b54b32f0acdd29", "name": "s3tests", "domain_id": "default", "description": "s3tests project", "enabled": true, "parent_id": "default", "is_domain": false, "tags": [], "options": {}, "links": {"self": "http://vm07.local:5000/v3/projects/5280482d1440427e99b54b32f0acdd29"}}} 2026-03-07T01:35:31.300 INFO:teuthology.orchestra.run.vm07.stderr: 2026-03-07T01:35:31.300 INFO:teuthology.orchestra.run.vm07.stderr:POST call to identity for http://vm07.local:5000/v3/projects used request id req-74f0c88c-1a11-4eae-a963-b7ab22a48f96 2026-03-07T01:35:31.300 INFO:teuthology.orchestra.run.vm07.stderr:clean_up CreateProject: 2026-03-07T01:35:31.301 INFO:teuthology.orchestra.run.vm07.stderr:END return value: 0 2026-03-07T01:35:31.301 INFO:teuthology.orchestra.run.vm07.stdout:+-------------+----------------------------------+ 2026-03-07T01:35:31.301 INFO:teuthology.orchestra.run.vm07.stdout:| Field | Value | 2026-03-07T01:35:31.301 INFO:teuthology.orchestra.run.vm07.stdout:+-------------+----------------------------------+ 2026-03-07T01:35:31.301 INFO:teuthology.orchestra.run.vm07.stdout:| description | s3tests project | 2026-03-07T01:35:31.301 INFO:teuthology.orchestra.run.vm07.stdout:| domain_id | default | 2026-03-07T01:35:31.301 INFO:teuthology.orchestra.run.vm07.stdout:| enabled | True | 2026-03-07T01:35:31.301 INFO:teuthology.orchestra.run.vm07.stdout:| id | 5280482d1440427e99b54b32f0acdd29 | 2026-03-07T01:35:31.301 INFO:teuthology.orchestra.run.vm07.stdout:| is_domain | False | 2026-03-07T01:35:31.301 INFO:teuthology.orchestra.run.vm07.stdout:| name | s3tests | 2026-03-07T01:35:31.301 INFO:teuthology.orchestra.run.vm07.stdout:| options | {} | 2026-03-07T01:35:31.301 INFO:teuthology.orchestra.run.vm07.stdout:| parent_id | default | 2026-03-07T01:35:31.301 INFO:teuthology.orchestra.run.vm07.stdout:| tags | [] | 2026-03-07T01:35:31.301 INFO:teuthology.orchestra.run.vm07.stdout:+-------------+----------------------------------+ 2026-03-07T01:35:31.416 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack user create --or-show --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://vm07.local:5000/v3 --password SECRET --project s3tests s3tests-main --debug 2026-03-07T01:35:31.769 INFO:teuthology.orchestra.run.vm07.stderr:START with options: user create --or-show --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://vm07.local:5000/v3 --password *** --project s3tests s3tests-main --debug 2026-03-07T01:35:31.769 INFO:teuthology.orchestra.run.vm07.stderr:options: Namespace(verbose_level=3, log_file=None, deferred_help=False, debug=True, cloud=None, region_name=None, cacert=None, cert=None, key=None, verify=None, insecure=None, default_domain='default', interface=None, service_provider=None, remote_project_name=None, remote_project_id=None, remote_project_domain_name=None, remote_project_domain_id=None, timing=False, os_beta_command=False, profile=None, os_compute_api_version=None, os_identity_api_version='3', os_image_api_version=None, os_network_api_version=None, os_object_api_version=None, os_volume_api_version=None, auth_type=None, auth_url='http://vm07.local:5000/v3', trust_id=None, username='admin', user_id=None, password='***', project_id=None, endpoint=None, token=*** system_scope=None, domain_id=None, domain_name=None, project_name='admin', project_domain_id='default', project_domain_name=None, auth_methods=None, identity_provider=None, protocol=None, client_id=None, client_secret=*** openid_scope=None, access_token_endpoint=None, discovery_endpoint=None, device_authorization_endpoint=None, code_challenge_method=None, identity_provider_url=None, access_token_type=None, access_token=*** oauth2_endpoint=None, oauth2_client_id=None, oauth2_client_secret=*** default_domain_id=None, default_domain_name=None, service_provider_endpoint=None, service_provider_entity_id=None, user_domain_id='default', user_domain_name=None, passcode=None, idp_otp_key=None, application_credential_secret=*** application_credential_id=None, application_credential_name=None, redirect_uri=None, code=None, consumer_key=None, consumer_secret=*** access_key=None, access_secret=*** os_project_name=None, os_project_id=None) 2026-03-07T01:35:31.770 INFO:teuthology.orchestra.run.vm07.stderr:Auth plugin password selected 2026-03-07T01:35:31.770 INFO:teuthology.orchestra.run.vm07.stderr:auth_config_hook(): {'api_timeout': None, 'verify': True, 'cacert': None, 'cert': None, 'key': None, 'baremetal_status_code_retries': '5', 'baremetal_introspection_status_code_retries': '5', 'image_status_code_retries': '5', 'disable_vendor_agent': {}, 'interface': 'public', 'floating_ip_source': 'neutron', 'image_api_use_tasks': False, 'image_format': 'qcow2', 'message': '', 'network_api_version': '2', 'object_store_api_version': '1', 'secgroup_source': 'neutron', 'status': 'active', 'auth': {'user_domain_id': 'default', 'project_domain_id': 'default', 'project_name': 'admin'}, 'verbose_level': 3, 'deferred_help': False, 'debug': True, 'default_domain': 'default', 'timing': False, 'auth_url': 'http://vm07.local:5000/v3', 'username': 'admin', 'password': '***', 'beta_command': False, 'identity_api_version': '3', 'region_name': '', 'auth_type': 'password', ': []} 2026-03-07T01:35:31.770 INFO:teuthology.orchestra.run.vm07.stderr:defaults: {'api_timeout': None, 'verify': True, 'cacert': None, 'cert': None, 'key': None, 'auth_type': 'password', 'baremetal_status_code_retries': 5, 'baremetal_introspection_status_code_retries': 5, 'image_status_code_retries': 5, 'disable_vendor_agent': {}, 'interface': 'public', 'floating_ip_source': 'neutron', 'image_api_use_tasks': False, 'image_format': 'qcow2', 'message': '', 'network_api_version': '2', 'object_store_api_version': '1', 'secgroup_source': 'neutron', 'status': 'active'} 2026-03-07T01:35:31.770 INFO:teuthology.orchestra.run.vm07.stderr:cloud cfg: {'api_timeout': None, 'verify': True, 'cacert': None, 'cert': None, 'key': None, 'baremetal_status_code_retries': '5', 'baremetal_introspection_status_code_retries': '5', 'image_status_code_retries': '5', 'disable_vendor_agent': {}, 'interface': 'public', 'floating_ip_source': 'neutron', 'image_api_use_tasks': False, 'image_format': 'qcow2', 'message': '', 'network_api_version': '2', 'object_store_api_version': '1', 'secgroup_source': 'neutron', 'status': 'active', 'auth': {'user_domain_id': 'default', 'project_domain_id': 'default', 'project_name': 'admin'}, 'verbose_level': 3, 'deferred_help': False, 'debug': True, 'default_domain': 'default', 'timing': False, 'auth_url': 'http://vm07.local:5000/v3', 'username': 'admin', 'password': '***', 'beta_command': False, 'identity_api_version': '3', 'region_name': '', 'auth_type': 'password', ': []} 2026-03-07T01:35:31.779 INFO:teuthology.orchestra.run.vm07.stderr:compute API version 2.1, cmd group openstack.compute.v2 2026-03-07T01:35:31.784 INFO:teuthology.orchestra.run.vm07.stderr:identity API version 3, cmd group openstack.identity.v3 2026-03-07T01:35:31.786 INFO:teuthology.orchestra.run.vm07.stderr:image API version 2, cmd group openstack.image.v2 2026-03-07T01:35:31.793 INFO:teuthology.orchestra.run.vm07.stderr:network API version 2, cmd group openstack.network.v2 2026-03-07T01:35:31.794 INFO:teuthology.orchestra.run.vm07.stderr:object_store API version 1, cmd group openstack.object_store.v1 2026-03-07T01:35:31.798 INFO:teuthology.orchestra.run.vm07.stderr:volume API version 3, cmd group openstack.volume.v3 2026-03-07T01:35:31.805 INFO:teuthology.orchestra.run.vm07.stderr:command: user create -> openstackclient.identity.v3.user.CreateUser (auth=True) 2026-03-07T01:35:31.805 INFO:teuthology.orchestra.run.vm07.stderr:Auth plugin password selected 2026-03-07T01:35:31.805 INFO:teuthology.orchestra.run.vm07.stderr:auth_config_hook(): {'api_timeout': None, 'verify': True, 'cacert': None, 'cert': None, 'key': None, 'baremetal_status_code_retries': '5', 'baremetal_introspection_status_code_retries': '5', 'image_status_code_retries': '5', 'disable_vendor_agent': {}, 'interface': 'public', 'floating_ip_source': 'neutron', 'image_api_use_tasks': False, 'image_format': 'qcow2', 'message': '', 'network_api_version': '2', 'object_store_api_version': '1', 'secgroup_source': 'neutron', 'status': 'active', 'auth': {'user_domain_id': 'default', 'project_domain_id': 'default', 'project_name': 'admin'}, 'additional_user_agent': [('osc-lib', '4.0.2')], 'verbose_level': 3, 'deferred_help': False, 'debug': True, 'default_domain': 'default', 'timing': False, 'auth_url': 'http://vm07.local:5000/v3', 'username': 'admin', 'password': '***', 'beta_command': False, 'identity_api_version': '3', 'region_name': '', 'auth_type': 'password', ': []} 2026-03-07T01:35:31.805 INFO:teuthology.orchestra.run.vm07.stderr:Using auth plugin: password 2026-03-07T01:35:31.805 INFO:teuthology.orchestra.run.vm07.stderr:Using parameters {'auth_url': 'http://vm07.local:5000/v3', 'project_name': 'admin', 'project_domain_id': 'default', 'username': 'admin', 'user_domain_id': 'default', 'password': '***'} 2026-03-07T01:35:31.806 INFO:teuthology.orchestra.run.vm07.stderr:Get auth_ref 2026-03-07T01:35:31.806 INFO:teuthology.orchestra.run.vm07.stderr:REQ: curl -g -i -X GET http://vm07.local:5000/v3 -H "Accept: application/json" -H "User-Agent: openstacksdk/4.5.0 keystoneauth1/5.10.0 python-requests/2.32.3 CPython/3.9.23" 2026-03-07T01:35:31.807 INFO:teuthology.orchestra.run.vm07.stderr:Starting new HTTP connection (1): vm07.local:5000 2026-03-07T01:35:31.809 INFO:tasks.keystone.client.0.vm07.stderr:[pid: 87024|app: 0|req: 4/4] 192.168.123.107 () {28 vars in 408 bytes} [Sat Mar 7 01:35:31 2026] GET /v3 => generated 250 bytes in 1 msecs (HTTP/1.1 200) 4 headers in 158 bytes (1 switches on core 0) 2026-03-07T01:35:31.809 INFO:teuthology.orchestra.run.vm07.stderr:http://vm07.local:5000 "GET /v3 HTTP/1.1" 200 250 2026-03-07T01:35:31.809 INFO:teuthology.orchestra.run.vm07.stderr:RESP: [200] Content-Length: 250 Content-Type: application/json Vary: X-Auth-Token x-openstack-request-id: req-89344c51-9145-4af6-ad6f-fd532cdf4a63 2026-03-07T01:35:31.809 INFO:teuthology.orchestra.run.vm07.stderr:RESP BODY: {"version": {"id": "v3.14", "status": "stable", "updated": "2020-04-07T00:00:00Z", "links": [{"rel": "self", "href": "http://vm07.local:5000/v3/"}], "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}]}} 2026-03-07T01:35:31.809 INFO:teuthology.orchestra.run.vm07.stderr:GET call to http://vm07.local:5000/v3 used request id req-89344c51-9145-4af6-ad6f-fd532cdf4a63 2026-03-07T01:35:31.809 INFO:teuthology.orchestra.run.vm07.stderr:Making authentication request to http://vm07.local:5000/v3/auth/tokens 2026-03-07T01:35:31.810 INFO:teuthology.orchestra.run.vm07.stderr:Resetting dropped connection: vm07.local 2026-03-07T01:35:32.013 INFO:tasks.keystone.client.0.vm07.stderr:[pid: 87024|app: 0|req: 5/5] 192.168.123.107 () {32 vars in 486 bytes} [Sat Mar 7 01:35:31 2026] POST /v3/auth/tokens => generated 1280 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 366 bytes (1 switches on core 0) 2026-03-07T01:35:32.014 INFO:teuthology.orchestra.run.vm07.stderr:http://vm07.local:5000 "POST /v3/auth/tokens HTTP/1.1" 201 1280 2026-03-07T01:35:32.014 INFO:teuthology.orchestra.run.vm07.stderr:{"token": {"methods": ["password"], "user": {"domain": {"id": "default", "name": "Default"}, "id": "1318af88229947e39e31de57e332cde5", "name": "admin", "password_expires_at": null}, "audit_ids": ["T0omdx-4QEy28nxGSoZ2mg"], "expires_at": "2026-03-07T01:35:31.000000Z", "issued_at": "2026-03-07T00:35:31.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "8a03bff5b7964bdda8c0b9bef8d37413", "name": "admin"}, "is_domain": false, "roles": [{"id": "cc8aa6f909c04852930a13073463781e", "name": "member"}, {"id": "559ea700c2c84d77afabc40246e7716f", "name": "reader"}, {"id": "9ee7ef3c186d416c85867232b2b06050", "name": "admin"}, {"id": "2eb9bc1fda4d43c09e464beb572f447c", "name": "manager"}], "catalog": [{"endpoints": [{"id": "0df67301a86141f5a6ac5f6d699311ef", "interface": "internal", "region_id": "RegionOne", "url": "http://vm07.local:5000/v3", "region": "RegionOne"}, {"id": "2c2d61a8d59e49deb258deed7a7cd56c", "interface": "admin", "region_id": "RegionOne", "url": "http://vm07.local:5000/v3", "region": "RegionOne"}, {"id": "4dfdd0b07d0d4995abb9107a0fbc6d21", "interface": "public", "region_id": "RegionOne", "url": "http://vm07.local:5000/v3", "region": "RegionOne"}], "id": "a1563c9d56324b20bd20f2f21ab65409", "type": "identity", "name": "keystone"}]}} 2026-03-07T01:35:32.072 INFO:teuthology.orchestra.run.vm07.stderr:run(Namespace(formatter='table', columns=[], noindent=False, variables=[], prefix='', max_width=0, fit_width=False, print_empty=False, name='s3tests-main', domain=None, project='s3tests', project_domain=None, password='SECRET', password_prompt=False, email=None, description=None, ignore_lockout_failure_attempts=False, no_ignore_lockout_failure_attempts=False, ignore_password_expiry=False, no_ignore_password_expiry=False, ignore_change_password_upon_first_use=False, no_ignore_change_password_upon_first_use=False, enable_lock_password=False, disable_lock_password=False, enable_multi_factor_auth=False, disable_multi_factor_auth=False, multi_factor_auth_rule=[], enable=False, disable=False, or_show=True)) 2026-03-07T01:35:32.073 INFO:teuthology.orchestra.run.vm07.stderr:REQ: curl -g -i -X GET "http://vm07.local:5000/v3/projects/s3tests?domain_id=None" -H "User-Agent: openstacksdk/4.5.0 keystoneauth1/5.10.0 python-requests/2.32.3 CPython/3.9.23" -H "X-Auth-Token: {SHA256}ce43c5683ba0d600515dcd7b4caa35e842842058707c5f92027ed5af083da20f" 2026-03-07T01:35:32.074 INFO:teuthology.orchestra.run.vm07.stderr:Resetting dropped connection: vm07.local 2026-03-07T01:35:32.106 INFO:tasks.keystone.client.0.vm07.stderr:[pid: 87024|app: 0|req: 6/6] 192.168.123.107 () {30 vars in 633 bytes} [Sat Mar 7 01:35:32 2026] GET /v3/projects/s3tests => generated 88 bytes in 31 msecs (HTTP/1.1 404) 4 headers in 164 bytes (1 switches on core 0) 2026-03-07T01:35:32.107 INFO:teuthology.orchestra.run.vm07.stderr:http://vm07.local:5000 "GET /v3/projects/s3tests HTTP/1.1" 404 88 2026-03-07T01:35:32.107 INFO:teuthology.orchestra.run.vm07.stderr:RESP: [404] Content-Length: 88 Content-Type: application/json Vary: X-Auth-Token x-openstack-request-id: req-89669eb8-f1d7-49e1-bacc-adb3ae746ae9 2026-03-07T01:35:32.107 INFO:teuthology.orchestra.run.vm07.stderr:RESP BODY: {"error":{"code":404,"message":"Could not find project: s3tests.","title":"Not Found"}} 2026-03-07T01:35:32.107 INFO:teuthology.orchestra.run.vm07.stderr: 2026-03-07T01:35:32.107 INFO:teuthology.orchestra.run.vm07.stderr:GET call to identity for http://vm07.local:5000/v3/projects/s3tests used request id req-89669eb8-f1d7-49e1-bacc-adb3ae746ae9 2026-03-07T01:35:32.107 INFO:teuthology.orchestra.run.vm07.stderr:REQ: curl -g -i -X GET "http://vm07.local:5000/v3/projects?domain_id=None&name=s3tests" -H "Accept: application/json" -H "User-Agent: openstacksdk/4.5.0 keystoneauth1/5.10.0 python-requests/2.32.3 CPython/3.9.23" -H "X-Auth-Token: {SHA256}ce43c5683ba0d600515dcd7b4caa35e842842058707c5f92027ed5af083da20f" 2026-03-07T01:35:32.107 INFO:teuthology.orchestra.run.vm07.stderr:Resetting dropped connection: vm07.local 2026-03-07T01:35:32.144 INFO:tasks.keystone.client.0.vm07.stderr:[pid: 87024|app: 0|req: 7/7] 192.168.123.107 () {30 vars in 655 bytes} [Sat Mar 7 01:35:32 2026] GET /v3/projects?name=s3tests => generated 416 bytes in 35 msecs (HTTP/1.1 200) 4 headers in 158 bytes (1 switches on core 0) 2026-03-07T01:35:32.144 INFO:teuthology.orchestra.run.vm07.stderr:http://vm07.local:5000 "GET /v3/projects?name=s3tests HTTP/1.1" 200 416 2026-03-07T01:35:32.144 INFO:teuthology.orchestra.run.vm07.stderr:RESP: [200] Content-Length: 416 Content-Type: application/json Vary: X-Auth-Token x-openstack-request-id: req-7f9f4f62-ccb1-410b-ab89-4af31d772d69 2026-03-07T01:35:32.144 INFO:teuthology.orchestra.run.vm07.stderr:RESP BODY: {"projects": [{"id": "5280482d1440427e99b54b32f0acdd29", "name": "s3tests", "domain_id": "default", "description": "s3tests project", "enabled": true, "parent_id": "default", "is_domain": false, "tags": [], "options": {}, "links": {"self": "http://vm07.local:5000/v3/projects/5280482d1440427e99b54b32f0acdd29"}}], "links": {"next": null, "self": "http://vm07.local:5000/v3/projects?name=s3tests", "previous": null}} 2026-03-07T01:35:32.144 INFO:teuthology.orchestra.run.vm07.stderr: 2026-03-07T01:35:32.144 INFO:teuthology.orchestra.run.vm07.stderr:GET call to identity for http://vm07.local:5000/v3/projects?name=s3tests used request id req-7f9f4f62-ccb1-410b-ab89-4af31d772d69 2026-03-07T01:35:32.145 INFO:teuthology.orchestra.run.vm07.stderr:REQ: curl -g -i -X POST http://vm07.local:5000/v3/users -H "Content-Type: application/json" -H "User-Agent: openstacksdk/4.5.0 keystoneauth1/5.10.0 python-requests/2.32.3 CPython/3.9.23" -H "X-Auth-Token: {SHA256}ce43c5683ba0d600515dcd7b4caa35e842842058707c5f92027ed5af083da20f" -d '{"user": {"enabled": true, "default_project_id": "5280482d1440427e99b54b32f0acdd29", "name": "s3tests-main", "password": "SECRET"}}' 2026-03-07T01:35:32.145 INFO:teuthology.orchestra.run.vm07.stderr:Resetting dropped connection: vm07.local 2026-03-07T01:35:32.347 INFO:tasks.keystone.client.0.vm07.stderr:[pid: 87024|app: 0|req: 8/8] 192.168.123.107 () {34 vars in 665 bytes} [Sat Mar 7 01:35:32 2026] POST /v3/users => generated 307 bytes in 201 msecs (HTTP/1.1 201) 4 headers in 163 bytes (1 switches on core 0) 2026-03-07T01:35:32.348 INFO:teuthology.orchestra.run.vm07.stderr:http://vm07.local:5000 "POST /v3/users HTTP/1.1" 201 307 2026-03-07T01:35:32.348 INFO:teuthology.orchestra.run.vm07.stderr:RESP: [201] Content-Length: 307 Content-Type: application/json Vary: X-Auth-Token x-openstack-request-id: req-baf99909-a85a-4724-b6f9-eadab8fe2e98 2026-03-07T01:35:32.348 INFO:teuthology.orchestra.run.vm07.stderr:RESP BODY: {"user": {"id": "b08410dadba74ddbbe8d2ab432f39fec", "name": "s3tests-main", "domain_id": "default", "enabled": true, "default_project_id": "5280482d1440427e99b54b32f0acdd29", "password_expires_at": null, "options": {}, "links": {"self": "http://vm07.local:5000/v3/users/b08410dadba74ddbbe8d2ab432f39fec"}}} 2026-03-07T01:35:32.348 INFO:teuthology.orchestra.run.vm07.stderr: 2026-03-07T01:35:32.348 INFO:teuthology.orchestra.run.vm07.stderr:POST call to identity for http://vm07.local:5000/v3/users used request id req-baf99909-a85a-4724-b6f9-eadab8fe2e98 2026-03-07T01:35:32.348 INFO:teuthology.orchestra.run.vm07.stderr:clean_up CreateUser: 2026-03-07T01:35:32.348 INFO:teuthology.orchestra.run.vm07.stderr:END return value: 0 2026-03-07T01:35:32.348 INFO:teuthology.orchestra.run.vm07.stdout:+---------------------+----------------------------------+ 2026-03-07T01:35:32.348 INFO:teuthology.orchestra.run.vm07.stdout:| Field | Value | 2026-03-07T01:35:32.348 INFO:teuthology.orchestra.run.vm07.stdout:+---------------------+----------------------------------+ 2026-03-07T01:35:32.348 INFO:teuthology.orchestra.run.vm07.stdout:| default_project_id | 5280482d1440427e99b54b32f0acdd29 | 2026-03-07T01:35:32.348 INFO:teuthology.orchestra.run.vm07.stdout:| domain_id | default | 2026-03-07T01:35:32.348 INFO:teuthology.orchestra.run.vm07.stdout:| email | None | 2026-03-07T01:35:32.348 INFO:teuthology.orchestra.run.vm07.stdout:| enabled | True | 2026-03-07T01:35:32.349 INFO:teuthology.orchestra.run.vm07.stdout:| id | b08410dadba74ddbbe8d2ab432f39fec | 2026-03-07T01:35:32.349 INFO:teuthology.orchestra.run.vm07.stdout:| name | s3tests-main | 2026-03-07T01:35:32.349 INFO:teuthology.orchestra.run.vm07.stdout:| description | None | 2026-03-07T01:35:32.349 INFO:teuthology.orchestra.run.vm07.stdout:| password_expires_at | None | 2026-03-07T01:35:32.349 INFO:teuthology.orchestra.run.vm07.stdout:+---------------------+----------------------------------+ 2026-03-07T01:35:32.448 DEBUG:teuthology.orchestra.run.vm07:> cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack ec2 credentials create --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://vm07.local:5000/v3 --project s3tests --user s3tests-main --debug 2026-03-07T01:35:32.815 INFO:teuthology.orchestra.run.vm07.stderr:START with options: ec2 credentials create --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://vm07.local:5000/v3 --project s3tests --user s3tests-main --debug 2026-03-07T01:35:32.816 INFO:teuthology.orchestra.run.vm07.stderr:options: Namespace(verbose_level=3, log_file=None, deferred_help=False, debug=True, cloud=None, region_name=None, cacert=None, cert=None, key=None, verify=None, insecure=None, default_domain='default', interface=None, service_provider=None, remote_project_name=None, remote_project_id=None, remote_project_domain_name=None, remote_project_domain_id=None, timing=False, os_beta_command=False, profile=None, os_compute_api_version=None, os_identity_api_version='3', os_image_api_version=None, os_network_api_version=None, os_object_api_version=None, os_volume_api_version=None, auth_type=None, auth_url='http://vm07.local:5000/v3', system_scope=None, domain_id=None, domain_name=None, project_id=None, project_name='admin', project_domain_id='default', project_domain_name=None, trust_id=None, default_domain_id=None, default_domain_name=None, user_id=None, username='admin', user_domain_id='default', user_domain_name=None, password='***', application_credential_secret=*** application_credential_id=None, application_credential_name=None, identity_provider=None, protocol=None, client_id=None, client_secret=*** openid_scope=None, access_token_endpoint=None, discovery_endpoint=None, access_token_type=None, idp_otp_key=None, endpoint=None, token=*** oauth2_endpoint=None, oauth2_client_id=None, oauth2_client_secret=*** consumer_key=None, consumer_secret=*** access_key=None, access_secret=*** identity_provider_url=None, service_provider_endpoint=None, service_provider_entity_id=None, redirect_uri=None, code=None, passcode=None, device_authorization_endpoint=None, code_challenge_method=None, access_token=*** auth_methods=None, os_project_name=None, os_project_id=None) 2026-03-07T01:35:32.816 INFO:teuthology.orchestra.run.vm07.stderr:Auth plugin password selected 2026-03-07T01:35:32.816 INFO:teuthology.orchestra.run.vm07.stderr:auth_config_hook(): {'api_timeout': None, 'verify': True, 'cacert': None, 'cert': None, 'key': None, 'baremetal_status_code_retries': '5', 'baremetal_introspection_status_code_retries': '5', 'image_status_code_retries': '5', 'disable_vendor_agent': {}, 'interface': 'public', 'floating_ip_source': 'neutron', 'image_api_use_tasks': False, 'image_format': 'qcow2', 'message': '', 'network_api_version': '2', 'object_store_api_version': '1', 'secgroup_source': 'neutron', 'status': 'active', 'auth': {'user_domain_id': 'default', 'project_domain_id': 'default', 'project_name': 'admin'}, 'verbose_level': 3, 'deferred_help': False, 'debug': True, 'default_domain': 'default', 'timing': False, 'auth_url': 'http://vm07.local:5000/v3', 'username': 'admin', 'password': '***', 'beta_command': False, 'identity_api_version': '3', 'region_name': '', 'auth_type': 'password', ': []} 2026-03-07T01:35:32.816 INFO:teuthology.orchestra.run.vm07.stderr:defaults: {'api_timeout': None, 'verify': True, 'cacert': None, 'cert': None, 'key': None, 'auth_type': 'password', 'baremetal_status_code_retries': 5, 'baremetal_introspection_status_code_retries': 5, 'image_status_code_retries': 5, 'disable_vendor_agent': {}, 'interface': 'public', 'floating_ip_source': 'neutron', 'image_api_use_tasks': False, 'image_format': 'qcow2', 'message': '', 'network_api_version': '2', 'object_store_api_version': '1', 'secgroup_source': 'neutron', 'status': 'active'} 2026-03-07T01:35:32.816 INFO:teuthology.orchestra.run.vm07.stderr:cloud cfg: {'api_timeout': None, 'verify': True, 'cacert': None, 'cert': None, 'key': None, 'baremetal_status_code_retries': '5', 'baremetal_introspection_status_code_retries': '5', 'image_status_code_retries': '5', 'disable_vendor_agent': {}, 'interface': 'public', 'floating_ip_source': 'neutron', 'image_api_use_tasks': False, 'image_format': 'qcow2', 'message': '', 'network_api_version': '2', 'object_store_api_version': '1', 'secgroup_source': 'neutron', 'status': 'active', 'auth': {'user_domain_id': 'default', 'project_domain_id': 'default', 'project_name': 'admin'}, 'verbose_level': 3, 'deferred_help': False, 'debug': True, 'default_domain': 'default', 'timing': False, 'auth_url': 'http://vm07.local:5000/v3', 'username': 'admin', 'password': '***', 'beta_command': False, 'identity_api_version': '3', 'region_name': '', 'auth_type': 'password', ': []} 2026-03-07T01:35:32.827 INFO:teuthology.orchestra.run.vm07.stderr:compute API version 2.1, cmd group openstack.compute.v2 2026-03-07T01:35:32.832 INFO:teuthology.orchestra.run.vm07.stderr:identity API version 3, cmd group openstack.identity.v3 2026-03-07T01:35:32.835 INFO:teuthology.orchestra.run.vm07.stderr:image API version 2, cmd group openstack.image.v2 2026-03-07T01:35:32.842 INFO:teuthology.orchestra.run.vm07.stderr:network API version 2, cmd group openstack.network.v2 2026-03-07T01:35:32.843 INFO:teuthology.orchestra.run.vm07.stderr:object_store API version 1, cmd group openstack.object_store.v1 2026-03-07T01:35:32.847 INFO:teuthology.orchestra.run.vm07.stderr:volume API version 3, cmd group openstack.volume.v3 2026-03-07T01:35:32.851 INFO:teuthology.orchestra.run.vm07.stderr:command: ec2 credentials create -> openstackclient.identity.v3.ec2creds.CreateEC2Creds (auth=True) 2026-03-07T01:35:32.851 INFO:teuthology.orchestra.run.vm07.stderr:Auth plugin password selected 2026-03-07T01:35:32.852 INFO:teuthology.orchestra.run.vm07.stderr:auth_config_hook(): {'api_timeout': None, 'verify': True, 'cacert': None, 'cert': None, 'key': None, 'baremetal_status_code_retries': '5', 'baremetal_introspection_status_code_retries': '5', 'image_status_code_retries': '5', 'disable_vendor_agent': {}, 'interface': 'public', 'floating_ip_source': 'neutron', 'image_api_use_tasks': False, 'image_format': 'qcow2', 'message': '', 'network_api_version': '2', 'object_store_api_version': '1', 'secgroup_source': 'neutron', 'status': 'active', 'auth': {'user_domain_id': 'default', 'project_domain_id': 'default', 'project_name': 'admin'}, 'additional_user_agent': [('osc-lib', '4.0.2')], 'verbose_level': 3, 'deferred_help': False, 'debug': True, 'default_domain': 'default', 'timing': False, 'auth_url': 'http://vm07.local:5000/v3', 'username': 'admin', 'password': '***', 'beta_command': False, 'identity_api_version': '3', 'region_name': '', 'auth_type': 'password', ': []} 2026-03-07T01:35:32.852 INFO:teuthology.orchestra.run.vm07.stderr:Using auth plugin: password 2026-03-07T01:35:32.852 INFO:teuthology.orchestra.run.vm07.stderr:Using parameters {'auth_url': 'http://vm07.local:5000/v3', 'project_name': 'admin', 'project_domain_id': 'default', 'username': 'admin', 'user_domain_id': 'default', 'password': '***'} 2026-03-07T01:35:32.853 INFO:teuthology.orchestra.run.vm07.stderr:Get auth_ref 2026-03-07T01:35:32.853 INFO:teuthology.orchestra.run.vm07.stderr:REQ: curl -g -i -X GET http://vm07.local:5000/v3 -H "Accept: application/json" -H "User-Agent: openstacksdk/4.5.0 keystoneauth1/5.10.0 python-requests/2.32.3 CPython/3.9.23" 2026-03-07T01:35:32.854 INFO:teuthology.orchestra.run.vm07.stderr:Starting new HTTP connection (1): vm07.local:5000 2026-03-07T01:35:32.856 INFO:tasks.keystone.client.0.vm07.stderr:[pid: 87024|app: 0|req: 9/9] 192.168.123.107 () {28 vars in 408 bytes} [Sat Mar 7 01:35:32 2026] GET /v3 => generated 250 bytes in 1 msecs (HTTP/1.1 200) 4 headers in 158 bytes (1 switches on core 0) 2026-03-07T01:35:32.856 INFO:teuthology.orchestra.run.vm07.stderr:http://vm07.local:5000 "GET /v3 HTTP/1.1" 200 250 2026-03-07T01:35:32.856 INFO:teuthology.orchestra.run.vm07.stderr:RESP: [200] Content-Length: 250 Content-Type: application/json Vary: X-Auth-Token x-openstack-request-id: req-a9180fe6-b303-4bcf-9be9-7c06b670b6fe 2026-03-07T01:35:32.856 INFO:teuthology.orchestra.run.vm07.stderr:RESP BODY: {"version": {"id": "v3.14", "status": "stable", "updated": "2020-04-07T00:00:00Z", "links": [{"rel": "self", "href": "http://vm07.local:5000/v3/"}], "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}]}} 2026-03-07T01:35:32.856 INFO:teuthology.orchestra.run.vm07.stderr:GET call to http://vm07.local:5000/v3 used request id req-a9180fe6-b303-4bcf-9be9-7c06b670b6fe 2026-03-07T01:35:32.856 INFO:teuthology.orchestra.run.vm07.stderr:Making authentication request to http://vm07.local:5000/v3/auth/tokens 2026-03-07T01:35:32.857 INFO:teuthology.orchestra.run.vm07.stderr:Resetting dropped connection: vm07.local 2026-03-07T01:35:33.064 INFO:tasks.keystone.client.0.vm07.stderr:[pid: 87024|app: 0|req: 10/10] 192.168.123.107 () {32 vars in 486 bytes} [Sat Mar 7 01:35:32 2026] POST /v3/auth/tokens => generated 1280 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 366 bytes (1 switches on core 0) 2026-03-07T01:35:33.064 INFO:teuthology.orchestra.run.vm07.stderr:http://vm07.local:5000 "POST /v3/auth/tokens HTTP/1.1" 201 1280 2026-03-07T01:35:33.064 INFO:teuthology.orchestra.run.vm07.stderr:{"token": {"methods": ["password"], "user": {"domain": {"id": "default", "name": "Default"}, "id": "1318af88229947e39e31de57e332cde5", "name": "admin", "password_expires_at": null}, "audit_ids": ["e-_pEHL7QjCX7qnMou-vQg"], "expires_at": "2026-03-07T01:35:33.000000Z", "issued_at": "2026-03-07T00:35:33.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "8a03bff5b7964bdda8c0b9bef8d37413", "name": "admin"}, "is_domain": false, "roles": [{"id": "cc8aa6f909c04852930a13073463781e", "name": "member"}, {"id": "559ea700c2c84d77afabc40246e7716f", "name": "reader"}, {"id": "9ee7ef3c186d416c85867232b2b06050", "name": "admin"}, {"id": "2eb9bc1fda4d43c09e464beb572f447c", "name": "manager"}], "catalog": [{"endpoints": [{"id": "0df67301a86141f5a6ac5f6d699311ef", "interface": "internal", "region_id": "RegionOne", "url": "http://vm07.local:5000/v3", "region": "RegionOne"}, {"id": "2c2d61a8d59e49deb258deed7a7cd56c", "interface": "admin", "region_id": "RegionOne", "url": "http://vm07.local:5000/v3", "region": "RegionOne"}, {"id": "4dfdd0b07d0d4995abb9107a0fbc6d21", "interface": "public", "region_id": "RegionOne", "url": "http://vm07.local:5000/v3", "region": "RegionOne"}], "id": "a1563c9d56324b20bd20f2f21ab65409", "type": "identity", "name": "keystone"}]}} 2026-03-07T01:35:33.142 INFO:teuthology.orchestra.run.vm07.stderr:run(Namespace(formatter='table', columns=[], noindent=False, variables=[], prefix='', max_width=0, fit_width=False, print_empty=False, project='s3tests', user='s3tests-main', user_domain=None, project_domain=None)) 2026-03-07T01:35:33.142 INFO:teuthology.orchestra.run.vm07.stderr:Instantiating identity client: 2026-03-07T01:35:33.142 INFO:teuthology.orchestra.run.vm07.stderr:REQ: curl -g -i -X GET http://vm07.local:5000/v3/users/s3tests-main -H "Accept: application/json" -H "User-Agent: python-keystoneclient" -H "X-Auth-Token: {SHA256}e20c2ec2790c2fd6e0a6abd91337183893261f019a266649bf1474a2dff9411f" 2026-03-07T01:35:33.143 INFO:teuthology.orchestra.run.vm07.stderr:Resetting dropped connection: vm07.local 2026-03-07T01:35:33.178 INFO:tasks.keystone.client.0.vm07.stderr:[pid: 87024|app: 0|req: 11/11] 192.168.123.107 () {30 vars in 594 bytes} [Sat Mar 7 01:35:33 2026] GET /v3/users/s3tests-main => generated 90 bytes in 34 msecs (HTTP/1.1 404) 4 headers in 164 bytes (1 switches on core 0) 2026-03-07T01:35:33.178 INFO:teuthology.orchestra.run.vm07.stderr:http://vm07.local:5000 "GET /v3/users/s3tests-main HTTP/1.1" 404 90 2026-03-07T01:35:33.178 INFO:teuthology.orchestra.run.vm07.stderr:RESP: [404] Content-Length: 90 Content-Type: application/json Vary: X-Auth-Token x-openstack-request-id: req-5832a7d9-2e15-4d33-8ba4-3e5854a74bef 2026-03-07T01:35:33.178 INFO:teuthology.orchestra.run.vm07.stderr:RESP BODY: {"error":{"code":404,"message":"Could not find user: s3tests-main.","title":"Not Found"}} 2026-03-07T01:35:33.178 INFO:teuthology.orchestra.run.vm07.stderr: 2026-03-07T01:35:33.178 INFO:teuthology.orchestra.run.vm07.stderr:GET call to identity for http://vm07.local:5000/v3/users/s3tests-main used request id req-5832a7d9-2e15-4d33-8ba4-3e5854a74bef 2026-03-07T01:35:33.178 INFO:teuthology.orchestra.run.vm07.stderr:Request returned failure status: 404 2026-03-07T01:35:33.178 INFO:teuthology.orchestra.run.vm07.stderr:REQ: curl -g -i -X GET http://vm07.local:5000/v3/users?name=s3tests-main -H "Accept: application/json" -H "User-Agent: python-keystoneclient" -H "X-Auth-Token: {SHA256}e20c2ec2790c2fd6e0a6abd91337183893261f019a266649bf1474a2dff9411f" 2026-03-07T01:35:33.179 INFO:teuthology.orchestra.run.vm07.stderr:Resetting dropped connection: vm07.local 2026-03-07T01:35:33.226 INFO:tasks.keystone.client.0.vm07.stderr:[pid: 87024|app: 0|req: 12/12] 192.168.123.107 () {30 vars in 603 bytes} [Sat Mar 7 01:35:33 2026] GET /v3/users?name=s3tests-main => generated 414 bytes in 46 msecs (HTTP/1.1 200) 4 headers in 158 bytes (1 switches on core 0) 2026-03-07T01:35:33.226 INFO:teuthology.orchestra.run.vm07.stderr:http://vm07.local:5000 "GET /v3/users?name=s3tests-main HTTP/1.1" 200 414 2026-03-07T01:35:33.226 INFO:teuthology.orchestra.run.vm07.stderr:RESP: [200] Content-Length: 414 Content-Type: application/json Vary: X-Auth-Token x-openstack-request-id: req-307f061e-3954-4505-9bcc-6483bb588f25 2026-03-07T01:35:33.226 INFO:teuthology.orchestra.run.vm07.stderr:RESP BODY: {"users": [{"id": "b08410dadba74ddbbe8d2ab432f39fec", "name": "s3tests-main", "domain_id": "default", "enabled": true, "default_project_id": "5280482d1440427e99b54b32f0acdd29", "password_expires_at": null, "options": {}, "links": {"self": "http://vm07.local:5000/v3/users/b08410dadba74ddbbe8d2ab432f39fec"}}], "links": {"next": null, "self": "http://vm07.local:5000/v3/users?name=s3tests-main", "previous": null}} 2026-03-07T01:35:33.226 INFO:teuthology.orchestra.run.vm07.stderr: 2026-03-07T01:35:33.226 INFO:teuthology.orchestra.run.vm07.stderr:GET call to identity for http://vm07.local:5000/v3/users?name=s3tests-main used request id req-307f061e-3954-4505-9bcc-6483bb588f25 2026-03-07T01:35:33.226 INFO:teuthology.orchestra.run.vm07.stderr:REQ: curl -g -i -X GET http://vm07.local:5000/v3/projects/s3tests -H "Accept: application/json" -H "User-Agent: python-keystoneclient" -H "X-Auth-Token: {SHA256}e20c2ec2790c2fd6e0a6abd91337183893261f019a266649bf1474a2dff9411f" 2026-03-07T01:35:33.227 INFO:teuthology.orchestra.run.vm07.stderr:Resetting dropped connection: vm07.local 2026-03-07T01:35:33.357 INFO:teuthology.orchestra.run.vm07.stderr:http://vm07.local:5000 "GET /v3/projects/s3tests HTTP/1.1" 404 88 2026-03-07T01:35:33.357 INFO:teuthology.orchestra.run.vm07.stderr:RESP: [404] Content-Length: 88 Content-Type: application/json Vary: X-Auth-Token x-openstack-request-id: req-99611694-9337-419b-9851-1fd60d09cbc6 2026-03-07T01:35:33.357 INFO:teuthology.orchestra.run.vm07.stderr:RESP BODY: {"error":{"code":404,"message":"Could not find project: s3tests.","title":"Not Found"}} 2026-03-07T01:35:33.357 INFO:teuthology.orchestra.run.vm07.stderr: 2026-03-07T01:35:33.357 INFO:teuthology.orchestra.run.vm07.stderr:GET call to identity for http://vm07.local:5000/v3/projects/s3tests used request id req-99611694-9337-419b-9851-1fd60d09cbc6 2026-03-07T01:35:33.357 INFO:teuthology.orchestra.run.vm07.stderr:Request returned failure status: 404 2026-03-07T01:35:33.357 INFO:teuthology.orchestra.run.vm07.stderr:REQ: curl -g -i -X GET http://vm07.local:5000/v3/projects?name=s3tests -H "Accept: application/json" -H "User-Agent: python-keystoneclient" -H "X-Auth-Token: {SHA256}e20c2ec2790c2fd6e0a6abd91337183893261f019a266649bf1474a2dff9411f" 2026-03-07T01:35:33.358 INFO:teuthology.orchestra.run.vm07.stderr:REQ: curl -g -i -X GET http://vm07.local:5000/v3/projects? -H "Accept: application/json" -H "User-Agent: python-keystoneclient" -H "X-Auth-Token: {SHA256}e20c2ec2790c2fd6e0a6abd91337183893261f019a266649bf1474a2dff9411f" 2026-03-07T01:35:33.358 INFO:teuthology.orchestra.run.vm07.stderr:Starting new HTTP connection (2): vm07.local:5000 2026-03-07T01:35:33.358 INFO:tasks.keystone.client.0.vm07.stderr:[pid: 87024|app: 0|req: 13/13] 192.168.123.107 () {30 vars in 590 bytes} [Sat Mar 7 01:35:33 2026] GET /v3/projects/s3tests => generated 88 bytes in 129 msecs (HTTP/1.1 404) 4 headers in 164 bytes (1 switches on core 0) 2026-03-07T01:35:33.398 INFO:teuthology.orchestra.run.vm07.stderr:http://vm07.local:5000 "GET /v3/projects HTTP/1.1" 200 730 2026-03-07T01:35:33.398 INFO:teuthology.orchestra.run.vm07.stderr:RESP: [200] Content-Length: 730 Content-Type: application/json Vary: X-Auth-Token x-openstack-request-id: req-614a8e2f-6a39-4aa4-8263-50ea0bcc8e86 2026-03-07T01:35:33.398 INFO:teuthology.orchestra.run.vm07.stderr:RESP BODY: {"projects": [{"id": "5280482d1440427e99b54b32f0acdd29", "name": "s3tests", "domain_id": "default", "description": "s3tests project", "enabled": true, "parent_id": "default", "is_domain": false, "tags": [], "options": {}, "links": {"self": "http://vm07.local:5000/v3/projects/5280482d1440427e99b54b32f0acdd29"}}, {"id": "8a03bff5b7964bdda8c0b9bef8d37413", "name": "admin", "domain_id": "default", "description": "Bootstrap project for initializing the cloud.", "enabled": true, "parent_id": "default", "is_domain": false, "tags": [], "options": {}, "links": {"self": "http://vm07.local:5000/v3/projects/8a03bff5b7964bdda8c0b9bef8d37413"}}], "links": {"next": null, "self": "http://vm07.local:5000/v3/projects", "previous": null}} 2026-03-07T01:35:33.398 INFO:teuthology.orchestra.run.vm07.stderr: 2026-03-07T01:35:33.398 INFO:teuthology.orchestra.run.vm07.stderr:GET call to identity for http://vm07.local:5000/v3/projects used request id req-614a8e2f-6a39-4aa4-8263-50ea0bcc8e86 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr:get() takes 1 positional argument but 2 were given 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr:Traceback (most recent call last): 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr: File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.9/site-packages/cliff/app.py", line 456, in run_subcommand 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr: result = cmd.run(parsed_args) 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr: File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.9/site-packages/osc_lib/command/command.py", line 47, in run 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr: return super().run(parsed_args) 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr: File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.9/site-packages/cliff/display.py", line 148, in run 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr: column_names, data = self.take_action(parsed_args) 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr: File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.9/site-packages/openstackclient/identity/v3/ec2creds.py", line 103, in take_action 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr: project = utils.find_resource( 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr: File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.9/site-packages/osc_lib/utils/__init__.py", line 314, in find_resource 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr: if res.get('id') == name_or_id or res.get('name') == name_or_id: 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr:TypeError: get() takes 1 positional argument but 2 were given 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr:clean_up CreateEC2Creds: get() takes 1 positional argument but 2 were given 2026-03-07T01:35:33.399 INFO:teuthology.orchestra.run.vm07.stderr:END return value: 1 2026-03-07T01:35:33.405 INFO:tasks.keystone.client.0.vm07.stderr:[pid: 87024|app: 0|req: 14/14] 192.168.123.107 () {30 vars in 574 bytes} [Sat Mar 7 01:35:33 2026] GET /v3/projects => generated 730 bytes in 46 msecs (HTTP/1.1 200) 4 headers in 158 bytes (1 switches on core 0) 2026-03-07T01:35:33.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-07T01:35:33.467 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthos/teuthology/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/home/teuthos/.local/share/uv/python/cpython-3.10.19-linux-x86_64-gnu/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthos/src/github.com_kshtsk_ceph_de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0/qa/tasks/keystone.py", line 393, in fill_keystone run_section_cmds(ctx, cclient, 'ec2 credentials create', '', File "/home/teuthos/src/github.com_kshtsk_ceph_de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0/qa/tasks/keystone.py", line 349, in run_section_cmds run_in_keystone_venv(ctx, cclient, File "/home/teuthos/src/github.com_kshtsk_ceph_de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0/qa/tasks/keystone.py", line 41, in run_in_keystone_venv return run_in_keystone_dir(ctx, client, File "/home/teuthos/src/github.com_kshtsk_ceph_de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0/qa/tasks/keystone.py", line 28, in run_in_keystone_dir return ctx.cluster.only(client).run( File "/home/teuthos/teuthology/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthos/teuthology/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthos/teuthology/teuthology/orchestra/remote.py", line 575, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthos/teuthology/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthos/teuthology/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthos/teuthology/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on vm07 with status 1: 'cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack ec2 credentials create --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://vm07.local:5000/v3 --project s3tests --user s3tests-main --debug' 2026-03-07T01:35:33.468 INFO:tasks.keystone:Stopping Keystone public instance 2026-03-07T01:35:33.468 DEBUG:tasks.keystone.client.0:waiting for process to exit 2026-03-07T01:35:33.468 INFO:teuthology.orchestra.run:waiting for 300 2026-03-07T01:35:33.859 INFO:tasks.keystone.client.0:Stopped 2026-03-07T01:35:33.859 INFO:tasks.keystone:Removing packaged dependencies of Keystone... 2026-03-07T01:35:33.859 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y erase cyrus-sasl-devel 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout: cyrus-sasl-devel x86_64 2.1.27-21.el9 @appstream 206 k 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout:Removing dependent packages: 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout: openldap-devel x86_64 2.6.8-4.el9.0.1 @appstream 3.7 M 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout:Removing unused dependencies: 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout: cyrus-sasl x86_64 2.1.27-21.el9 @baseos 143 k 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout:Remove 3 Packages 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 4.1 M 2026-03-07T01:35:34.097 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:35:34.100 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:35:34.100 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:35:34.114 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:35:34.114 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:35:34.156 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:35:34.161 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : openldap-devel-2.6.8-4.el9.0.1.x86_64 1/3 2026-03-07T01:35:34.163 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : cyrus-sasl-devel-2.1.27-21.el9.x86_64 2/3 2026-03-07T01:35:34.180 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: cyrus-sasl-2.1.27-21.el9.x86_64 3/3 2026-03-07T01:35:34.181 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : cyrus-sasl-2.1.27-21.el9.x86_64 3/3 2026-03-07T01:35:34.306 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: cyrus-sasl-2.1.27-21.el9.x86_64 3/3 2026-03-07T01:35:34.306 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : cyrus-sasl-2.1.27-21.el9.x86_64 1/3 2026-03-07T01:35:34.306 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : cyrus-sasl-devel-2.1.27-21.el9.x86_64 2/3 2026-03-07T01:35:34.355 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openldap-devel-2.6.8-4.el9.0.1.x86_64 3/3 2026-03-07T01:35:34.355 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:34.355 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:35:34.355 INFO:teuthology.orchestra.run.vm07.stdout: cyrus-sasl-2.1.27-21.el9.x86_64 cyrus-sasl-devel-2.1.27-21.el9.x86_64 2026-03-07T01:35:34.355 INFO:teuthology.orchestra.run.vm07.stdout: openldap-devel-2.6.8-4.el9.0.1.x86_64 2026-03-07T01:35:34.355 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:34.355 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:35:34.385 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y erase libffi-devel 2026-03-07T01:35:34.673 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:35:34.674 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:34.674 INFO:teuthology.orchestra.run.vm07.stdout: Package Architecture Version Repository Size 2026-03-07T01:35:34.674 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:34.674 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:35:34.674 INFO:teuthology.orchestra.run.vm07.stdout: libffi-devel x86_64 3.4.2-8.el9 @appstream 33 k 2026-03-07T01:35:34.674 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:34.674 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:35:34.674 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:34.674 INFO:teuthology.orchestra.run.vm07.stdout:Remove 1 Package 2026-03-07T01:35:34.674 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:34.674 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 33 k 2026-03-07T01:35:34.674 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:35:34.678 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:35:34.679 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:35:34.680 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:35:34.681 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:35:34.714 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:35:34.739 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libffi-devel-3.4.2-8.el9.x86_64 1/1 2026-03-07T01:35:34.826 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libffi-devel-3.4.2-8.el9.x86_64 1/1 2026-03-07T01:35:34.890 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libffi-devel-3.4.2-8.el9.x86_64 1/1 2026-03-07T01:35:34.890 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:34.890 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:35:34.890 INFO:teuthology.orchestra.run.vm07.stdout: libffi-devel-3.4.2-8.el9.x86_64 2026-03-07T01:35:34.890 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:34.890 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:35:34.940 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y erase libxml2-devel 2026-03-07T01:35:35.226 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout: libxml2-devel x86_64 2.9.13-14.el9_7 @appstream 8.8 M 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout:Removing dependent packages: 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout: libxslt-devel x86_64 1.1.34-13.el9_6 @appstream 2.4 M 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout:Removing unused dependencies: 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout: cmake-filesystem x86_64 3.26.5-3.el9_7 @appstream 0 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout: libgpg-error-devel x86_64 1.42-5.el9 @appstream 228 k 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout: xz-devel x86_64 5.2.5-8.el9_0 @appstream 202 k 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout:Remove 5 Packages 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 12 M 2026-03-07T01:35:35.229 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:35:35.235 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:35:35.235 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:35:35.260 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:35:35.260 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:35:35.318 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:35:35.333 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libxslt-devel-1.1.34-13.el9_6.x86_64 1/5 2026-03-07T01:35:35.339 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libxml2-devel-2.9.13-14.el9_7.x86_64 2/5 2026-03-07T01:35:35.341 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : cmake-filesystem-3.26.5-3.el9_7.x86_64 3/5 2026-03-07T01:35:35.344 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : xz-devel-5.2.5-8.el9_0.x86_64 4/5 2026-03-07T01:35:35.366 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libgpg-error-devel-1.42-5.el9.x86_64 5/5 2026-03-07T01:35:35.456 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libgpg-error-devel-1.42-5.el9.x86_64 5/5 2026-03-07T01:35:35.456 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : cmake-filesystem-3.26.5-3.el9_7.x86_64 1/5 2026-03-07T01:35:35.456 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libgpg-error-devel-1.42-5.el9.x86_64 2/5 2026-03-07T01:35:35.456 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libxml2-devel-2.9.13-14.el9_7.x86_64 3/5 2026-03-07T01:35:35.456 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libxslt-devel-1.1.34-13.el9_6.x86_64 4/5 2026-03-07T01:35:35.529 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : xz-devel-5.2.5-8.el9_0.x86_64 5/5 2026-03-07T01:35:35.530 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:35.530 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:35:35.530 INFO:teuthology.orchestra.run.vm07.stdout: cmake-filesystem-3.26.5-3.el9_7.x86_64 libgpg-error-devel-1.42-5.el9.x86_64 2026-03-07T01:35:35.530 INFO:teuthology.orchestra.run.vm07.stdout: libxml2-devel-2.9.13-14.el9_7.x86_64 libxslt-devel-1.1.34-13.el9_6.x86_64 2026-03-07T01:35:35.530 INFO:teuthology.orchestra.run.vm07.stdout: xz-devel-5.2.5-8.el9_0.x86_64 2026-03-07T01:35:35.530 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:35.530 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:35:35.587 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y erase libxslt-devel 2026-03-07T01:35:35.812 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: libxslt-devel 2026-03-07T01:35:35.812 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:35:35.816 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:35:35.816 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:35:35.816 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:35:35.844 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y erase mariadb 2026-03-07T01:35:36.031 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout: mariadb x86_64 3:10.5.29-3.el9_7 @appstream 21 M 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout:Removing dependent packages: 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-server x86_64 3:10.5.29-3.el9_7 @appstream 63 M 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout:Removing unused dependencies: 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-backup x86_64 3:10.5.29-3.el9_7 @appstream 24 M 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-common x86_64 3:10.5.29-3.el9_7 @appstream 179 k 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-errmsg x86_64 3:10.5.29-3.el9_7 @appstream 2.6 M 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-gssapi-server x86_64 3:10.5.29-3.el9_7 @appstream 20 k 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-server-utils x86_64 3:10.5.29-3.el9_7 @appstream 801 k 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout: mysql-selinux noarch 1.0.14-1.el9_6 @appstream 50 k 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout: perl-DBD-MariaDB x86_64 1.21-17.el9 @appstream 382 k 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout: perl-DBI x86_64 1.643-9.el9 @appstream 1.9 M 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout: perl-Math-BigInt noarch 1:1.9998.18-460.el9 @appstream 709 k 2026-03-07T01:35:36.032 INFO:teuthology.orchestra.run.vm07.stdout: perl-Math-Complex noarch 1.59-481.1.el9_6 @appstream 86 k 2026-03-07T01:35:36.033 INFO:teuthology.orchestra.run.vm07.stdout: perl-Sys-Hostname x86_64 1.23-481.1.el9_6 @appstream 21 k 2026-03-07T01:35:36.033 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:36.033 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:35:36.033 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:36.033 INFO:teuthology.orchestra.run.vm07.stdout:Remove 13 Packages 2026-03-07T01:35:36.033 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:36.033 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 115 M 2026-03-07T01:35:36.033 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:35:36.037 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:35:36.037 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:35:36.058 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:35:36.059 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:35:36.100 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:35:36.103 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : mariadb-gssapi-server-3:10.5.29-3.el9_7.x86_64 1/13 2026-03-07T01:35:36.106 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : mariadb-backup-3:10.5.29-3.el9_7.x86_64 2/13 2026-03-07T01:35:36.420 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: mariadb-server-3:10.5.29-3.el9_7.x86_64 3/13 2026-03-07T01:35:36.420 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : mariadb-server-3:10.5.29-3.el9_7.x86_64 3/13 2026-03-07T01:35:36.434 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: mariadb-server-3:10.5.29-3.el9_7.x86_64 3/13 2026-03-07T01:35:36.438 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : mariadb-3:10.5.29-3.el9_7.x86_64 4/13 2026-03-07T01:35:36.442 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : mariadb-server-utils-3:10.5.29-3.el9_7.x86_64 5/13 2026-03-07T01:35:36.445 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : mariadb-errmsg-3:10.5.29-3.el9_7.x86_64 6/13 2026-03-07T01:35:36.447 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : mariadb-common-3:10.5.29-3.el9_7.x86_64 7/13 2026-03-07T01:35:36.447 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : mysql-selinux-1.0.14-1.el9_6.noarch 8/13 2026-03-07T01:35:41.687 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: mysql-selinux-1.0.14-1.el9_6.noarch 8/13 2026-03-07T01:35:41.693 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : perl-DBD-MariaDB-1.21-17.el9.x86_64 9/13 2026-03-07T01:35:41.698 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : perl-DBI-1.643-9.el9.x86_64 10/13 2026-03-07T01:35:41.700 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : perl-Math-BigInt-1:1.9998.18-460.el9.noarch 11/13 2026-03-07T01:35:41.702 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : perl-Math-Complex-1.59-481.1.el9_6.noarch 12/13 2026-03-07T01:35:41.717 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : perl-Sys-Hostname-1.23-481.1.el9_6.x86_64 13/13 2026-03-07T01:35:41.791 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: perl-Sys-Hostname-1.23-481.1.el9_6.x86_64 13/13 2026-03-07T01:35:41.791 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-3:10.5.29-3.el9_7.x86_64 1/13 2026-03-07T01:35:41.791 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-backup-3:10.5.29-3.el9_7.x86_64 2/13 2026-03-07T01:35:41.791 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-common-3:10.5.29-3.el9_7.x86_64 3/13 2026-03-07T01:35:41.791 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-errmsg-3:10.5.29-3.el9_7.x86_64 4/13 2026-03-07T01:35:41.791 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-gssapi-server-3:10.5.29-3.el9_7.x86_64 5/13 2026-03-07T01:35:41.791 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-server-3:10.5.29-3.el9_7.x86_64 6/13 2026-03-07T01:35:41.791 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-server-utils-3:10.5.29-3.el9_7.x86_64 7/13 2026-03-07T01:35:41.791 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mysql-selinux-1.0.14-1.el9_6.noarch 8/13 2026-03-07T01:35:41.791 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : perl-DBD-MariaDB-1.21-17.el9.x86_64 9/13 2026-03-07T01:35:41.791 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : perl-DBI-1.643-9.el9.x86_64 10/13 2026-03-07T01:35:41.791 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : perl-Math-BigInt-1:1.9998.18-460.el9.noarch 11/13 2026-03-07T01:35:41.791 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : perl-Math-Complex-1.59-481.1.el9_6.noarch 12/13 2026-03-07T01:35:41.836 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : perl-Sys-Hostname-1.23-481.1.el9_6.x86_64 13/13 2026-03-07T01:35:41.836 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:41.836 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-backup-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-common-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-errmsg-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-gssapi-server-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-server-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-server-utils-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout: mysql-selinux-1.0.14-1.el9_6.noarch 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout: perl-DBD-MariaDB-1.21-17.el9.x86_64 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout: perl-DBI-1.643-9.el9.x86_64 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout: perl-Math-BigInt-1:1.9998.18-460.el9.noarch 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout: perl-Math-Complex-1.59-481.1.el9_6.noarch 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout: perl-Sys-Hostname-1.23-481.1.el9_6.x86_64 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:41.837 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:35:41.869 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y erase mariadb-devel 2026-03-07T01:35:42.142 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:35:42.143 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:42.143 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:35:42.143 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:42.143 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-devel x86_64 3:10.5.29-3.el9_7 @crb 5.5 M 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout:Removing unused dependencies: 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c x86_64 3.2.6-1.el9_0 @appstream 540 k 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c-config noarch 3.2.6-1.el9_0 @appstream 497 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c-devel x86_64 3.2.6-1.el9_0 @appstream 184 k 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c-doc noarch 3.2.6-1.el9_0 @crb 72 k 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout: openssl-devel x86_64 1:3.5.1-7.el9_7 @appstream 5.3 M 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout: zlib-devel x86_64 1.2.11-40.el9 @appstream 138 k 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout:Remove 7 Packages 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 12 M 2026-03-07T01:35:42.144 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:35:42.154 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:35:42.154 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:35:42.209 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:35:42.209 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:35:42.316 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:35:42.322 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : mariadb-devel-3:10.5.29-3.el9_7.x86_64 1/7 2026-03-07T01:35:42.328 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : mariadb-connector-c-devel-3.2.6-1.el9_0.x86_64 2/7 2026-03-07T01:35:42.500 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : mariadb-connector-c-doc-3.2.6-1.el9_0.noarch 3/7 2026-03-07T01:35:42.517 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : openssl-devel-1:3.5.1-7.el9_7.x86_64 4/7 2026-03-07T01:35:42.520 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : zlib-devel-1.2.11-40.el9.x86_64 5/7 2026-03-07T01:35:42.523 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : mariadb-connector-c-3.2.6-1.el9_0.x86_64 6/7 2026-03-07T01:35:42.539 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : mariadb-connector-c-config-3.2.6-1.el9_0.noarch 7/7 2026-03-07T01:35:42.599 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: mariadb-connector-c-config-3.2.6-1.el9_0.noarch 7/7 2026-03-07T01:35:42.599 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-connector-c-3.2.6-1.el9_0.x86_64 1/7 2026-03-07T01:35:42.599 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-connector-c-config-3.2.6-1.el9_0.noarch 2/7 2026-03-07T01:35:42.599 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-connector-c-devel-3.2.6-1.el9_0.x86_64 3/7 2026-03-07T01:35:42.599 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-connector-c-doc-3.2.6-1.el9_0.noarch 4/7 2026-03-07T01:35:42.599 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mariadb-devel-3:10.5.29-3.el9_7.x86_64 5/7 2026-03-07T01:35:42.599 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openssl-devel-1:3.5.1-7.el9_7.x86_64 6/7 2026-03-07T01:35:42.643 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 7/7 2026-03-07T01:35:42.643 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:42.643 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:35:42.643 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c-3.2.6-1.el9_0.x86_64 2026-03-07T01:35:42.643 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c-config-3.2.6-1.el9_0.noarch 2026-03-07T01:35:42.643 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c-devel-3.2.6-1.el9_0.x86_64 2026-03-07T01:35:42.643 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-connector-c-doc-3.2.6-1.el9_0.noarch 2026-03-07T01:35:42.643 INFO:teuthology.orchestra.run.vm07.stdout: mariadb-devel-3:10.5.29-3.el9_7.x86_64 2026-03-07T01:35:42.643 INFO:teuthology.orchestra.run.vm07.stdout: openssl-devel-1:3.5.1-7.el9_7.x86_64 2026-03-07T01:35:42.643 INFO:teuthology.orchestra.run.vm07.stdout: zlib-devel-1.2.11-40.el9.x86_64 2026-03-07T01:35:42.643 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:42.643 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:35:42.671 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y erase mariadb-server 2026-03-07T01:35:42.855 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: mariadb-server 2026-03-07T01:35:42.855 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:35:42.859 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:35:42.859 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:35:42.859 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:35:42.884 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y erase openldap-devel 2026-03-07T01:35:43.050 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: openldap-devel 2026-03-07T01:35:43.050 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:35:43.053 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:35:43.054 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:35:43.054 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:35:43.077 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y erase openssl-devel 2026-03-07T01:35:43.244 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: openssl-devel 2026-03-07T01:35:43.244 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:35:43.247 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:35:43.248 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:35:43.248 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:35:43.270 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y erase postgresql 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout: postgresql x86_64 13.23-1.el9_7 @appstream 5.9 M 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout:Removing dependent packages: 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout: postgresql-server x86_64 13.23-1.el9_7 @appstream 23 M 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout:Removing unused dependencies: 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout: postgresql-private-libs x86_64 13.23-1.el9_7 @appstream 339 k 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout:Remove 3 Packages 2026-03-07T01:35:43.445 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:43.446 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 29 M 2026-03-07T01:35:43.446 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:35:43.448 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:35:43.449 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:35:43.464 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:35:43.464 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:35:43.499 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:35:43.525 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: postgresql-server-13.23-1.el9_7.x86_64 1/3 2026-03-07T01:35:43.525 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : postgresql-server-13.23-1.el9_7.x86_64 1/3 2026-03-07T01:35:43.552 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: postgresql-server-13.23-1.el9_7.x86_64 1/3 2026-03-07T01:35:43.556 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : postgresql-13.23-1.el9_7.x86_64 2/3 2026-03-07T01:35:43.572 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : postgresql-private-libs-13.23-1.el9_7.x86_64 3/3 2026-03-07T01:35:43.641 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: postgresql-private-libs-13.23-1.el9_7.x86_64 3/3 2026-03-07T01:35:43.641 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : postgresql-13.23-1.el9_7.x86_64 1/3 2026-03-07T01:35:43.641 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : postgresql-private-libs-13.23-1.el9_7.x86_64 2/3 2026-03-07T01:35:43.682 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : postgresql-server-13.23-1.el9_7.x86_64 3/3 2026-03-07T01:35:43.682 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:43.682 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:35:43.682 INFO:teuthology.orchestra.run.vm07.stdout: postgresql-13.23-1.el9_7.x86_64 2026-03-07T01:35:43.682 INFO:teuthology.orchestra.run.vm07.stdout: postgresql-private-libs-13.23-1.el9_7.x86_64 2026-03-07T01:35:43.682 INFO:teuthology.orchestra.run.vm07.stdout: postgresql-server-13.23-1.el9_7.x86_64 2026-03-07T01:35:43.682 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:43.682 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:35:43.730 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y erase postgresql-devel 2026-03-07T01:35:44.004 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:35:44.005 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:44.005 INFO:teuthology.orchestra.run.vm07.stdout: Package Architecture Version Repository Size 2026-03-07T01:35:44.005 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:44.005 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:35:44.005 INFO:teuthology.orchestra.run.vm07.stdout: libpq-devel x86_64 13.23-1.el9_7 @appstream 321 k 2026-03-07T01:35:44.005 INFO:teuthology.orchestra.run.vm07.stdout:Removing unused dependencies: 2026-03-07T01:35:44.005 INFO:teuthology.orchestra.run.vm07.stdout: libpq x86_64 13.23-1.el9_7 @appstream 735 k 2026-03-07T01:35:44.005 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:44.005 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:35:44.005 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:35:44.005 INFO:teuthology.orchestra.run.vm07.stdout:Remove 2 Packages 2026-03-07T01:35:44.005 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:44.005 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 1.0 M 2026-03-07T01:35:44.006 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:35:44.008 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:35:44.008 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:35:44.023 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:35:44.023 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:35:44.069 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:35:44.074 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libpq-devel-13.23-1.el9_7.x86_64 1/2 2026-03-07T01:35:44.148 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libpq-13.23-1.el9_7.x86_64 2/2 2026-03-07T01:35:44.148 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libpq-13.23-1.el9_7.x86_64 1/2 2026-03-07T01:35:44.193 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libpq-devel-13.23-1.el9_7.x86_64 2/2 2026-03-07T01:35:44.193 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:44.193 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:35:44.193 INFO:teuthology.orchestra.run.vm07.stdout: libpq-13.23-1.el9_7.x86_64 libpq-devel-13.23-1.el9_7.x86_64 2026-03-07T01:35:44.193 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:44.193 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:35:44.221 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y erase postgresql-server 2026-03-07T01:35:44.381 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: postgresql-server 2026-03-07T01:35:44.381 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:35:44.384 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:35:44.385 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:35:44.385 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:35:44.408 INFO:tasks.keystone:Removing keystone... 2026-03-07T01:35:44.408 DEBUG:teuthology.orchestra.run.vm07:> rm -rf /home/ubuntu/cephtest/keystone 2026-03-07T01:35:45.410 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthos/teuthology/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/home/teuthos/.local/share/uv/python/cpython-3.10.19-linux-x86_64-gnu/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthos/src/github.com_kshtsk_ceph_de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0/qa/tasks/keystone.py", line 507, in task with contextutil.nested( File "/home/teuthos/.local/share/uv/python/cpython-3.10.19-linux-x86_64-gnu/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthos/teuthology/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthos/.local/share/uv/python/cpython-3.10.19-linux-x86_64-gnu/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthos/src/github.com_kshtsk_ceph_de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0/qa/tasks/keystone.py", line 89, in download yield File "/home/teuthos/teuthology/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/home/teuthos/.local/share/uv/python/cpython-3.10.19-linux-x86_64-gnu/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthos/src/github.com_kshtsk_ceph_de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0/qa/tasks/keystone.py", line 393, in fill_keystone run_section_cmds(ctx, cclient, 'ec2 credentials create', '', File "/home/teuthos/src/github.com_kshtsk_ceph_de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0/qa/tasks/keystone.py", line 349, in run_section_cmds run_in_keystone_venv(ctx, cclient, File "/home/teuthos/src/github.com_kshtsk_ceph_de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0/qa/tasks/keystone.py", line 41, in run_in_keystone_venv return run_in_keystone_dir(ctx, client, File "/home/teuthos/src/github.com_kshtsk_ceph_de3f6b2e3e13d3f18deaa37f46086ffedfedd8d0/qa/tasks/keystone.py", line 28, in run_in_keystone_dir return ctx.cluster.only(client).run( File "/home/teuthos/teuthology/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthos/teuthology/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthos/teuthology/teuthology/orchestra/remote.py", line 575, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthos/teuthology/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthos/teuthology/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthos/teuthology/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on vm07 with status 1: 'cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack ec2 credentials create --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://vm07.local:5000/v3 --project s3tests --user s3tests-main --debug' 2026-03-07T01:35:45.411 DEBUG:teuthology.run_tasks:Unwinding manager keystone 2026-03-07T01:35:45.413 DEBUG:teuthology.run_tasks:Unwinding manager tox 2026-03-07T01:35:45.415 DEBUG:teuthology.orchestra.run.vm07:> rm -rf /home/ubuntu/cephtest/tox-venv 2026-03-07T01:35:45.476 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-03-07T01:35:45.478 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-03-07T01:35:45.478 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-03-07T01:35:45.642 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:45.642 INFO:teuthology.orchestra.run.vm07.stderr:dumped all 2026-03-07T01:35:45.653 INFO:teuthology.orchestra.run.vm07.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2026-03-07T01:35:44.028359+0100","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81888,"kb_used_data":1368,"kb_used_omap":4,"kb_used_meta":80443,"kb_avail":314490912,"statfs":{"total":322122547200,"available":322038693888,"internally_reserved":0,"allocated":1400832,"data_stored":1061821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4788,"internal_metadata":82373964},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001540"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353578+0100","last_change":"2026-03-07T01:32:49.842673+0100","last_active":"2026-03-07T01:33:14.353578+0100","last_peered":"2026-03-07T01:33:14.353578+0100","last_clean":"2026-03-07T01:33:14.353578+0100","last_became_active":"2026-03-07T01:32:47.833028+0100","last_became_peered":"2026-03-07T01:32:47.833028+0100","last_unstale":"2026-03-07T01:33:14.353578+0100","last_undegraded":"2026-03-07T01:33:14.353578+0100","last_fullsized":"2026-03-07T01:33:14.353578+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T06:46:34.331258+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027108699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353603+0100","last_change":"2026-03-07T01:32:49.845320+0100","last_active":"2026-03-07T01:33:14.353603+0100","last_peered":"2026-03-07T01:33:14.353603+0100","last_clean":"2026-03-07T01:33:14.353603+0100","last_became_active":"2026-03-07T01:32:47.833125+0100","last_became_peered":"2026-03-07T01:32:47.833125+0100","last_unstale":"2026-03-07T01:33:14.353603+0100","last_undegraded":"2026-03-07T01:33:14.353603+0100","last_fullsized":"2026-03-07T01:33:14.353603+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T04:29:36.888078+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039410900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353626+0100","last_change":"2026-03-07T01:32:49.845222+0100","last_active":"2026-03-07T01:33:14.353626+0100","last_peered":"2026-03-07T01:33:14.353626+0100","last_clean":"2026-03-07T01:33:14.353626+0100","last_became_active":"2026-03-07T01:32:47.833210+0100","last_became_peered":"2026-03-07T01:32:47.833210+0100","last_unstale":"2026-03-07T01:33:14.353626+0100","last_undegraded":"2026-03-07T01:33:14.353626+0100","last_fullsized":"2026-03-07T01:33:14.353626+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T08:00:17.280495+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036142800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353676+0100","last_change":"2026-03-07T01:32:49.842708+0100","last_active":"2026-03-07T01:33:14.353676+0100","last_peered":"2026-03-07T01:33:14.353676+0100","last_clean":"2026-03-07T01:33:14.353676+0100","last_became_active":"2026-03-07T01:32:47.833276+0100","last_became_peered":"2026-03-07T01:32:47.833276+0100","last_unstale":"2026-03-07T01:33:14.353676+0100","last_undegraded":"2026-03-07T01:33:14.353676+0100","last_fullsized":"2026-03-07T01:33:14.353676+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T09:30:23.161677+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021422100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.296367+0100","last_change":"2026-03-07T01:32:49.837905+0100","last_active":"2026-03-07T01:33:14.296367+0100","last_peered":"2026-03-07T01:33:14.296367+0100","last_clean":"2026-03-07T01:33:14.296367+0100","last_became_active":"2026-03-07T01:32:47.837875+0100","last_became_peered":"2026-03-07T01:32:47.837875+0100","last_unstale":"2026-03-07T01:33:14.296367+0100","last_undegraded":"2026-03-07T01:33:14.296367+0100","last_fullsized":"2026-03-07T01:33:14.296367+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:43:52.534537+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000191418,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:13.232373+0100","last_change":"2026-03-07T01:32:50.097629+0100","last_active":"2026-03-07T01:33:13.232373+0100","last_peered":"2026-03-07T01:33:13.232373+0100","last_clean":"2026-03-07T01:33:13.232373+0100","last_became_active":"2026-03-07T01:32:47.839227+0100","last_became_peered":"2026-03-07T01:32:47.839227+0100","last_unstale":"2026-03-07T01:33:13.232373+0100","last_undegraded":"2026-03-07T01:33:13.232373+0100","last_fullsized":"2026-03-07T01:33:13.232373+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:43:52.534537+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038883800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:13.232396+0100","last_change":"2026-03-07T01:32:50.097804+0100","last_active":"2026-03-07T01:33:13.232396+0100","last_peered":"2026-03-07T01:33:13.232396+0100","last_clean":"2026-03-07T01:33:13.232396+0100","last_became_active":"2026-03-07T01:32:47.838194+0100","last_became_peered":"2026-03-07T01:32:47.838194+0100","last_unstale":"2026-03-07T01:33:13.232396+0100","last_undegraded":"2026-03-07T01:33:13.232396+0100","last_fullsized":"2026-03-07T01:33:13.232396+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T10:41:58.144437+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000262742,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353706+0100","last_change":"2026-03-07T01:32:49.842796+0100","last_active":"2026-03-07T01:33:14.353706+0100","last_peered":"2026-03-07T01:33:14.353706+0100","last_clean":"2026-03-07T01:33:14.353706+0100","last_became_active":"2026-03-07T01:32:47.833341+0100","last_became_peered":"2026-03-07T01:32:47.833341+0100","last_unstale":"2026-03-07T01:33:14.353706+0100","last_undegraded":"2026-03-07T01:33:14.353706+0100","last_fullsized":"2026-03-07T01:33:14.353706+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T03:13:46.022033+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024972699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'32","reported_seq":71,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353488+0100","last_change":"2026-03-07T01:32:41.806893+0100","last_active":"2026-03-07T01:33:14.353488+0100","last_peered":"2026-03-07T01:33:14.353488+0100","last_clean":"2026-03-07T01:33:14.353488+0100","last_became_active":"2026-03-07T01:32:41.806810+0100","last_became_peered":"2026-03-07T01:32:41.806810+0100","last_unstale":"2026-03-07T01:33:14.353488+0100","last_undegraded":"2026-03-07T01:33:14.353488+0100","last_fullsized":"2026-03-07T01:33:14.353488+0100","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:40.792540+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:40.792540+0100","last_clean_scrub_stamp":"2026-03-07T01:32:40.792540+0100","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T11:29:56.806508+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738406,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":26992,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830608,"statfs":{"total":107374182400,"available":107346542592,"internally_reserved":0,"allocated":155648,"data_stored":47741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738406,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27448,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830152,"statfs":{"total":107374182400,"available":107346075648,"internally_reserved":0,"allocated":622592,"data_stored":507040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27448,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830152,"statfs":{"total":107374182400,"available":107346075648,"internally_reserved":0,"allocated":622592,"data_stored":507040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-07T01:35:45.653 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-03-07T01:35:45.819 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:45.819 INFO:teuthology.orchestra.run.vm07.stderr:dumped all 2026-03-07T01:35:45.830 INFO:teuthology.orchestra.run.vm07.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2026-03-07T01:35:44.028359+0100","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81888,"kb_used_data":1368,"kb_used_omap":4,"kb_used_meta":80443,"kb_avail":314490912,"statfs":{"total":322122547200,"available":322038693888,"internally_reserved":0,"allocated":1400832,"data_stored":1061821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4788,"internal_metadata":82373964},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001540"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353578+0100","last_change":"2026-03-07T01:32:49.842673+0100","last_active":"2026-03-07T01:33:14.353578+0100","last_peered":"2026-03-07T01:33:14.353578+0100","last_clean":"2026-03-07T01:33:14.353578+0100","last_became_active":"2026-03-07T01:32:47.833028+0100","last_became_peered":"2026-03-07T01:32:47.833028+0100","last_unstale":"2026-03-07T01:33:14.353578+0100","last_undegraded":"2026-03-07T01:33:14.353578+0100","last_fullsized":"2026-03-07T01:33:14.353578+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T06:46:34.331258+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027108699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353603+0100","last_change":"2026-03-07T01:32:49.845320+0100","last_active":"2026-03-07T01:33:14.353603+0100","last_peered":"2026-03-07T01:33:14.353603+0100","last_clean":"2026-03-07T01:33:14.353603+0100","last_became_active":"2026-03-07T01:32:47.833125+0100","last_became_peered":"2026-03-07T01:32:47.833125+0100","last_unstale":"2026-03-07T01:33:14.353603+0100","last_undegraded":"2026-03-07T01:33:14.353603+0100","last_fullsized":"2026-03-07T01:33:14.353603+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T04:29:36.888078+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039410900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353626+0100","last_change":"2026-03-07T01:32:49.845222+0100","last_active":"2026-03-07T01:33:14.353626+0100","last_peered":"2026-03-07T01:33:14.353626+0100","last_clean":"2026-03-07T01:33:14.353626+0100","last_became_active":"2026-03-07T01:32:47.833210+0100","last_became_peered":"2026-03-07T01:32:47.833210+0100","last_unstale":"2026-03-07T01:33:14.353626+0100","last_undegraded":"2026-03-07T01:33:14.353626+0100","last_fullsized":"2026-03-07T01:33:14.353626+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T08:00:17.280495+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036142800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353676+0100","last_change":"2026-03-07T01:32:49.842708+0100","last_active":"2026-03-07T01:33:14.353676+0100","last_peered":"2026-03-07T01:33:14.353676+0100","last_clean":"2026-03-07T01:33:14.353676+0100","last_became_active":"2026-03-07T01:32:47.833276+0100","last_became_peered":"2026-03-07T01:32:47.833276+0100","last_unstale":"2026-03-07T01:33:14.353676+0100","last_undegraded":"2026-03-07T01:33:14.353676+0100","last_fullsized":"2026-03-07T01:33:14.353676+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T09:30:23.161677+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021422100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.296367+0100","last_change":"2026-03-07T01:32:49.837905+0100","last_active":"2026-03-07T01:33:14.296367+0100","last_peered":"2026-03-07T01:33:14.296367+0100","last_clean":"2026-03-07T01:33:14.296367+0100","last_became_active":"2026-03-07T01:32:47.837875+0100","last_became_peered":"2026-03-07T01:32:47.837875+0100","last_unstale":"2026-03-07T01:33:14.296367+0100","last_undegraded":"2026-03-07T01:33:14.296367+0100","last_fullsized":"2026-03-07T01:33:14.296367+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:43:52.534537+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000191418,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:13.232373+0100","last_change":"2026-03-07T01:32:50.097629+0100","last_active":"2026-03-07T01:33:13.232373+0100","last_peered":"2026-03-07T01:33:13.232373+0100","last_clean":"2026-03-07T01:33:13.232373+0100","last_became_active":"2026-03-07T01:32:47.839227+0100","last_became_peered":"2026-03-07T01:32:47.839227+0100","last_unstale":"2026-03-07T01:33:13.232373+0100","last_undegraded":"2026-03-07T01:33:13.232373+0100","last_fullsized":"2026-03-07T01:33:13.232373+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:43:52.534537+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038883800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:13.232396+0100","last_change":"2026-03-07T01:32:50.097804+0100","last_active":"2026-03-07T01:33:13.232396+0100","last_peered":"2026-03-07T01:33:13.232396+0100","last_clean":"2026-03-07T01:33:13.232396+0100","last_became_active":"2026-03-07T01:32:47.838194+0100","last_became_peered":"2026-03-07T01:32:47.838194+0100","last_unstale":"2026-03-07T01:33:13.232396+0100","last_undegraded":"2026-03-07T01:33:13.232396+0100","last_fullsized":"2026-03-07T01:33:13.232396+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T10:41:58.144437+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000262742,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353706+0100","last_change":"2026-03-07T01:32:49.842796+0100","last_active":"2026-03-07T01:33:14.353706+0100","last_peered":"2026-03-07T01:33:14.353706+0100","last_clean":"2026-03-07T01:33:14.353706+0100","last_became_active":"2026-03-07T01:32:47.833341+0100","last_became_peered":"2026-03-07T01:32:47.833341+0100","last_unstale":"2026-03-07T01:33:14.353706+0100","last_undegraded":"2026-03-07T01:33:14.353706+0100","last_fullsized":"2026-03-07T01:33:14.353706+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T03:13:46.022033+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024972699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'32","reported_seq":71,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353488+0100","last_change":"2026-03-07T01:32:41.806893+0100","last_active":"2026-03-07T01:33:14.353488+0100","last_peered":"2026-03-07T01:33:14.353488+0100","last_clean":"2026-03-07T01:33:14.353488+0100","last_became_active":"2026-03-07T01:32:41.806810+0100","last_became_peered":"2026-03-07T01:32:41.806810+0100","last_unstale":"2026-03-07T01:33:14.353488+0100","last_undegraded":"2026-03-07T01:33:14.353488+0100","last_fullsized":"2026-03-07T01:33:14.353488+0100","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:40.792540+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:40.792540+0100","last_clean_scrub_stamp":"2026-03-07T01:32:40.792540+0100","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T11:29:56.806508+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738406,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":26992,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830608,"statfs":{"total":107374182400,"available":107346542592,"internally_reserved":0,"allocated":155648,"data_stored":47741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738406,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27448,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830152,"statfs":{"total":107374182400,"available":107346075648,"internally_reserved":0,"allocated":622592,"data_stored":507040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27448,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830152,"statfs":{"total":107374182400,"available":107346075648,"internally_reserved":0,"allocated":622592,"data_stored":507040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-07T01:35:45.830 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-03-07T01:35:45.830 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-03-07T01:35:45.997 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:45.997 INFO:teuthology.orchestra.run.vm07.stderr:dumped all 2026-03-07T01:35:46.007 INFO:teuthology.orchestra.run.vm07.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2026-03-07T01:35:44.028359+0100","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81888,"kb_used_data":1368,"kb_used_omap":4,"kb_used_meta":80443,"kb_avail":314490912,"statfs":{"total":322122547200,"available":322038693888,"internally_reserved":0,"allocated":1400832,"data_stored":1061821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4788,"internal_metadata":82373964},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001540"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353578+0100","last_change":"2026-03-07T01:32:49.842673+0100","last_active":"2026-03-07T01:33:14.353578+0100","last_peered":"2026-03-07T01:33:14.353578+0100","last_clean":"2026-03-07T01:33:14.353578+0100","last_became_active":"2026-03-07T01:32:47.833028+0100","last_became_peered":"2026-03-07T01:32:47.833028+0100","last_unstale":"2026-03-07T01:33:14.353578+0100","last_undegraded":"2026-03-07T01:33:14.353578+0100","last_fullsized":"2026-03-07T01:33:14.353578+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T06:46:34.331258+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027108699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353603+0100","last_change":"2026-03-07T01:32:49.845320+0100","last_active":"2026-03-07T01:33:14.353603+0100","last_peered":"2026-03-07T01:33:14.353603+0100","last_clean":"2026-03-07T01:33:14.353603+0100","last_became_active":"2026-03-07T01:32:47.833125+0100","last_became_peered":"2026-03-07T01:32:47.833125+0100","last_unstale":"2026-03-07T01:33:14.353603+0100","last_undegraded":"2026-03-07T01:33:14.353603+0100","last_fullsized":"2026-03-07T01:33:14.353603+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T04:29:36.888078+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039410900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353626+0100","last_change":"2026-03-07T01:32:49.845222+0100","last_active":"2026-03-07T01:33:14.353626+0100","last_peered":"2026-03-07T01:33:14.353626+0100","last_clean":"2026-03-07T01:33:14.353626+0100","last_became_active":"2026-03-07T01:32:47.833210+0100","last_became_peered":"2026-03-07T01:32:47.833210+0100","last_unstale":"2026-03-07T01:33:14.353626+0100","last_undegraded":"2026-03-07T01:33:14.353626+0100","last_fullsized":"2026-03-07T01:33:14.353626+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T08:00:17.280495+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036142800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353676+0100","last_change":"2026-03-07T01:32:49.842708+0100","last_active":"2026-03-07T01:33:14.353676+0100","last_peered":"2026-03-07T01:33:14.353676+0100","last_clean":"2026-03-07T01:33:14.353676+0100","last_became_active":"2026-03-07T01:32:47.833276+0100","last_became_peered":"2026-03-07T01:32:47.833276+0100","last_unstale":"2026-03-07T01:33:14.353676+0100","last_undegraded":"2026-03-07T01:33:14.353676+0100","last_fullsized":"2026-03-07T01:33:14.353676+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T09:30:23.161677+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021422100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.296367+0100","last_change":"2026-03-07T01:32:49.837905+0100","last_active":"2026-03-07T01:33:14.296367+0100","last_peered":"2026-03-07T01:33:14.296367+0100","last_clean":"2026-03-07T01:33:14.296367+0100","last_became_active":"2026-03-07T01:32:47.837875+0100","last_became_peered":"2026-03-07T01:32:47.837875+0100","last_unstale":"2026-03-07T01:33:14.296367+0100","last_undegraded":"2026-03-07T01:33:14.296367+0100","last_fullsized":"2026-03-07T01:33:14.296367+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:43:52.534537+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000191418,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:13.232373+0100","last_change":"2026-03-07T01:32:50.097629+0100","last_active":"2026-03-07T01:33:13.232373+0100","last_peered":"2026-03-07T01:33:13.232373+0100","last_clean":"2026-03-07T01:33:13.232373+0100","last_became_active":"2026-03-07T01:32:47.839227+0100","last_became_peered":"2026-03-07T01:32:47.839227+0100","last_unstale":"2026-03-07T01:33:13.232373+0100","last_undegraded":"2026-03-07T01:33:13.232373+0100","last_fullsized":"2026-03-07T01:33:13.232373+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:43:52.534537+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038883800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:13.232396+0100","last_change":"2026-03-07T01:32:50.097804+0100","last_active":"2026-03-07T01:33:13.232396+0100","last_peered":"2026-03-07T01:33:13.232396+0100","last_clean":"2026-03-07T01:33:13.232396+0100","last_became_active":"2026-03-07T01:32:47.838194+0100","last_became_peered":"2026-03-07T01:32:47.838194+0100","last_unstale":"2026-03-07T01:33:13.232396+0100","last_undegraded":"2026-03-07T01:33:13.232396+0100","last_fullsized":"2026-03-07T01:33:13.232396+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T10:41:58.144437+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000262742,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353706+0100","last_change":"2026-03-07T01:32:49.842796+0100","last_active":"2026-03-07T01:33:14.353706+0100","last_peered":"2026-03-07T01:33:14.353706+0100","last_clean":"2026-03-07T01:33:14.353706+0100","last_became_active":"2026-03-07T01:32:47.833341+0100","last_became_peered":"2026-03-07T01:32:47.833341+0100","last_unstale":"2026-03-07T01:33:14.353706+0100","last_undegraded":"2026-03-07T01:33:14.353706+0100","last_fullsized":"2026-03-07T01:33:14.353706+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T03:13:46.022033+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024972699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'32","reported_seq":71,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353488+0100","last_change":"2026-03-07T01:32:41.806893+0100","last_active":"2026-03-07T01:33:14.353488+0100","last_peered":"2026-03-07T01:33:14.353488+0100","last_clean":"2026-03-07T01:33:14.353488+0100","last_became_active":"2026-03-07T01:32:41.806810+0100","last_became_peered":"2026-03-07T01:32:41.806810+0100","last_unstale":"2026-03-07T01:33:14.353488+0100","last_undegraded":"2026-03-07T01:33:14.353488+0100","last_fullsized":"2026-03-07T01:33:14.353488+0100","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:40.792540+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:40.792540+0100","last_clean_scrub_stamp":"2026-03-07T01:32:40.792540+0100","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T11:29:56.806508+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738406,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":26992,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830608,"statfs":{"total":107374182400,"available":107346542592,"internally_reserved":0,"allocated":155648,"data_stored":47741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738406,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27448,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830152,"statfs":{"total":107374182400,"available":107346075648,"internally_reserved":0,"allocated":622592,"data_stored":507040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27448,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830152,"statfs":{"total":107374182400,"available":107346075648,"internally_reserved":0,"allocated":622592,"data_stored":507040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-07T01:35:46.008 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-03-07T01:35:46.175 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:46.175 INFO:teuthology.orchestra.run.vm07.stdout:{"epoch":18,"fsid":"d293b3a5-efef-4619-a378-e22bf171f656","created":"2026-03-07T01:32:30.908414+0100","modified":"2026-03-07T01:33:13.226197+0100","last_up_change":"2026-03-07T01:32:39.790389+0100","last_in_change":"2026-03-07T01:32:32.302050+0100","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-07T01:32:40.027844+0100","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-03-07T01:32:46.227445+0100","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"daa44bd6-c2bc-499a-ac45-6b794811e9a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6808","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6809","nonce":2333053155}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6810","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6811","nonce":2333053155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6814","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6815","nonce":2333053155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6812","nonce":2333053155},{"type":"v1","addr":"192.168.123.107:6813","nonce":2333053155}]},"public_addr":"192.168.123.107:6809/2333053155","cluster_addr":"192.168.123.107:6811/2333053155","heartbeat_back_addr":"192.168.123.107:6815/2333053155","heartbeat_front_addr":"192.168.123.107:6813/2333053155","state":["exists","up"]},{"osd":1,"uuid":"601f26d9-99b1-479b-8035-4eb34cf754a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6816","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6817","nonce":184725705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6818","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6819","nonce":184725705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6822","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6823","nonce":184725705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6820","nonce":184725705},{"type":"v1","addr":"192.168.123.107:6821","nonce":184725705}]},"public_addr":"192.168.123.107:6817/184725705","cluster_addr":"192.168.123.107:6819/184725705","heartbeat_back_addr":"192.168.123.107:6823/184725705","heartbeat_front_addr":"192.168.123.107:6821/184725705","state":["exists","up"]},{"osd":2,"uuid":"33d80069-4964-41fd-8a41-ff59422d0b28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6800","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6801","nonce":967594618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6802","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6803","nonce":967594618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6806","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6807","nonce":967594618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.107:6804","nonce":967594618},{"type":"v1","addr":"192.168.123.107:6805","nonce":967594618}]},"public_addr":"192.168.123.107:6801/967594618","cluster_addr":"192.168.123.107:6803/967594618","heartbeat_back_addr":"192.168.123.107:6807/967594618","heartbeat_front_addr":"192.168.123.107:6805/967594618","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-07T01:32:35.189346+0100","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-07T01:32:35.363273+0100","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-07T01:32:35.096137+0100","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-07T01:35:47.187 INFO:tasks.ceph:Scrubbing osd.0 2026-03-07T01:35:47.187 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-03-07T01:35:47.281 INFO:teuthology.orchestra.run.vm07.stdout:{ 2026-03-07T01:35:47.281 INFO:teuthology.orchestra.run.vm07.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-03-07T01:35:47.281 INFO:teuthology.orchestra.run.vm07.stdout:} 2026-03-07T01:35:47.290 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-03-07T01:35:47.462 INFO:teuthology.orchestra.run.vm07.stderr:instructed osd(s) 0 to deep-scrub 2026-03-07T01:35:47.474 INFO:tasks.ceph:Scrubbing osd.1 2026-03-07T01:35:47.474 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-03-07T01:35:47.563 INFO:teuthology.orchestra.run.vm07.stdout:{ 2026-03-07T01:35:47.563 INFO:teuthology.orchestra.run.vm07.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-03-07T01:35:47.563 INFO:teuthology.orchestra.run.vm07.stdout:} 2026-03-07T01:35:47.572 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-03-07T01:35:47.744 INFO:teuthology.orchestra.run.vm07.stderr:instructed osd(s) 1 to deep-scrub 2026-03-07T01:35:47.758 INFO:tasks.ceph:Scrubbing osd.2 2026-03-07T01:35:47.758 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-03-07T01:35:47.850 INFO:teuthology.orchestra.run.vm07.stdout:{ 2026-03-07T01:35:47.850 INFO:teuthology.orchestra.run.vm07.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-03-07T01:35:47.850 INFO:teuthology.orchestra.run.vm07.stdout:} 2026-03-07T01:35:47.859 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-03-07T01:35:48.030 INFO:teuthology.orchestra.run.vm07.stderr:instructed osd(s) 2 to deep-scrub 2026-03-07T01:35:48.043 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-03-07T01:35:48.224 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:35:48.224 INFO:teuthology.orchestra.run.vm07.stderr:dumped all 2026-03-07T01:35:48.236 INFO:teuthology.orchestra.run.vm07.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2026-03-07T01:35:48.028834+0100","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81888,"kb_used_data":1368,"kb_used_omap":4,"kb_used_meta":80443,"kb_avail":314490912,"statfs":{"total":322122547200,"available":322038693888,"internally_reserved":0,"allocated":1400832,"data_stored":1061821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4788,"internal_metadata":82373964},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001447"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353578+0100","last_change":"2026-03-07T01:32:49.842673+0100","last_active":"2026-03-07T01:33:14.353578+0100","last_peered":"2026-03-07T01:33:14.353578+0100","last_clean":"2026-03-07T01:33:14.353578+0100","last_became_active":"2026-03-07T01:32:47.833028+0100","last_became_peered":"2026-03-07T01:32:47.833028+0100","last_unstale":"2026-03-07T01:33:14.353578+0100","last_undegraded":"2026-03-07T01:33:14.353578+0100","last_fullsized":"2026-03-07T01:33:14.353578+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T06:46:34.331258+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027108699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353603+0100","last_change":"2026-03-07T01:32:49.845320+0100","last_active":"2026-03-07T01:33:14.353603+0100","last_peered":"2026-03-07T01:33:14.353603+0100","last_clean":"2026-03-07T01:33:14.353603+0100","last_became_active":"2026-03-07T01:32:47.833125+0100","last_became_peered":"2026-03-07T01:32:47.833125+0100","last_unstale":"2026-03-07T01:33:14.353603+0100","last_undegraded":"2026-03-07T01:33:14.353603+0100","last_fullsized":"2026-03-07T01:33:14.353603+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T04:29:36.888078+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039410900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353626+0100","last_change":"2026-03-07T01:32:49.845222+0100","last_active":"2026-03-07T01:33:14.353626+0100","last_peered":"2026-03-07T01:33:14.353626+0100","last_clean":"2026-03-07T01:33:14.353626+0100","last_became_active":"2026-03-07T01:32:47.833210+0100","last_became_peered":"2026-03-07T01:32:47.833210+0100","last_unstale":"2026-03-07T01:33:14.353626+0100","last_undegraded":"2026-03-07T01:33:14.353626+0100","last_fullsized":"2026-03-07T01:33:14.353626+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T08:00:17.280495+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036142800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353676+0100","last_change":"2026-03-07T01:32:49.842708+0100","last_active":"2026-03-07T01:33:14.353676+0100","last_peered":"2026-03-07T01:33:14.353676+0100","last_clean":"2026-03-07T01:33:14.353676+0100","last_became_active":"2026-03-07T01:32:47.833276+0100","last_became_peered":"2026-03-07T01:32:47.833276+0100","last_unstale":"2026-03-07T01:33:14.353676+0100","last_undegraded":"2026-03-07T01:33:14.353676+0100","last_fullsized":"2026-03-07T01:33:14.353676+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T09:30:23.161677+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021422100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.296367+0100","last_change":"2026-03-07T01:32:49.837905+0100","last_active":"2026-03-07T01:33:14.296367+0100","last_peered":"2026-03-07T01:33:14.296367+0100","last_clean":"2026-03-07T01:33:14.296367+0100","last_became_active":"2026-03-07T01:32:47.837875+0100","last_became_peered":"2026-03-07T01:32:47.837875+0100","last_unstale":"2026-03-07T01:33:14.296367+0100","last_undegraded":"2026-03-07T01:33:14.296367+0100","last_fullsized":"2026-03-07T01:33:14.296367+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:43:52.534537+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000191418,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:13.232373+0100","last_change":"2026-03-07T01:32:50.097629+0100","last_active":"2026-03-07T01:33:13.232373+0100","last_peered":"2026-03-07T01:33:13.232373+0100","last_clean":"2026-03-07T01:33:13.232373+0100","last_became_active":"2026-03-07T01:32:47.839227+0100","last_became_peered":"2026-03-07T01:32:47.839227+0100","last_unstale":"2026-03-07T01:33:13.232373+0100","last_undegraded":"2026-03-07T01:33:13.232373+0100","last_fullsized":"2026-03-07T01:33:13.232373+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:43:52.534537+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038883800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:13.232396+0100","last_change":"2026-03-07T01:32:50.097804+0100","last_active":"2026-03-07T01:33:13.232396+0100","last_peered":"2026-03-07T01:33:13.232396+0100","last_clean":"2026-03-07T01:33:13.232396+0100","last_became_active":"2026-03-07T01:32:47.838194+0100","last_became_peered":"2026-03-07T01:32:47.838194+0100","last_unstale":"2026-03-07T01:33:13.232396+0100","last_undegraded":"2026-03-07T01:33:13.232396+0100","last_fullsized":"2026-03-07T01:33:13.232396+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T10:41:58.144437+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000262742,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353706+0100","last_change":"2026-03-07T01:32:49.842796+0100","last_active":"2026-03-07T01:33:14.353706+0100","last_peered":"2026-03-07T01:33:14.353706+0100","last_clean":"2026-03-07T01:33:14.353706+0100","last_became_active":"2026-03-07T01:32:47.833341+0100","last_became_peered":"2026-03-07T01:32:47.833341+0100","last_unstale":"2026-03-07T01:33:14.353706+0100","last_undegraded":"2026-03-07T01:33:14.353706+0100","last_fullsized":"2026-03-07T01:33:14.353706+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:46.817358+0100","last_clean_scrub_stamp":"2026-03-07T01:32:46.817358+0100","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T03:13:46.022033+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024972699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'32","reported_seq":71,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:33:14.353488+0100","last_change":"2026-03-07T01:32:41.806893+0100","last_active":"2026-03-07T01:33:14.353488+0100","last_peered":"2026-03-07T01:33:14.353488+0100","last_clean":"2026-03-07T01:33:14.353488+0100","last_became_active":"2026-03-07T01:32:41.806810+0100","last_became_peered":"2026-03-07T01:32:41.806810+0100","last_unstale":"2026-03-07T01:33:14.353488+0100","last_undegraded":"2026-03-07T01:33:14.353488+0100","last_fullsized":"2026-03-07T01:33:14.353488+0100","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:32:40.792540+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:32:40.792540+0100","last_clean_scrub_stamp":"2026-03-07T01:32:40.792540+0100","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T11:29:56.806508+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738407,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":26992,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830608,"statfs":{"total":107374182400,"available":107346542592,"internally_reserved":0,"allocated":155648,"data_stored":47741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738407,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27448,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830152,"statfs":{"total":107374182400,"available":107346075648,"internally_reserved":0,"allocated":622592,"data_stored":507040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27448,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830152,"statfs":{"total":107374182400,"available":107346075648,"internally_reserved":0,"allocated":622592,"data_stored":507040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-07T01:35:48.237 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-03-07T01:32:46.817358+0100 time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=32, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=35, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=0) 2026-03-07T01:35:48.238 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-03-07T01:32:46.817358+0100 time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=32, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=35, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=0) 2026-03-07T01:35:48.238 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-03-07T01:32:46.817358+0100 time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=32, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=35, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=0) 2026-03-07T01:35:48.238 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-03-07T01:32:46.817358+0100 time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=32, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=35, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=0) 2026-03-07T01:35:48.238 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-03-07T01:32:46.817358+0100 time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=32, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=35, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=0) 2026-03-07T01:35:48.238 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-03-07T01:32:46.817358+0100 time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=32, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=35, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=0) 2026-03-07T01:35:48.238 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-03-07T01:32:46.817358+0100 time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=32, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=35, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=0) 2026-03-07T01:35:48.238 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-03-07T01:32:46.817358+0100 time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=32, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=35, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=0) 2026-03-07T01:35:48.238 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-03-07T01:32:40.792540+0100 time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=32, tm_sec=40, tm_wday=5, tm_yday=66, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=3, tm_mday=7, tm_hour=1, tm_min=35, tm_sec=46, tm_wday=5, tm_yday=66, tm_isdst=0) 2026-03-07T01:35:48.238 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-03-07T01:36:08.239 DEBUG:teuthology.orchestra.run.vm07:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-03-07T01:36:08.424 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:08.424 INFO:teuthology.orchestra.run.vm07.stderr:dumped all 2026-03-07T01:36:08.437 INFO:teuthology.orchestra.run.vm07.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2026-03-07T01:36:08.031635+0100","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81864,"kb_used_data":1368,"kb_used_omap":4,"kb_used_meta":80443,"kb_avail":314490936,"statfs":{"total":322122547200,"available":322038718464,"internally_reserved":0,"allocated":1400832,"data_stored":1061821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4788,"internal_metadata":82373964},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001672"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:35:49.374607+0100","last_change":"2026-03-07T01:35:49.374623+0100","last_active":"2026-03-07T01:35:49.374607+0100","last_peered":"2026-03-07T01:35:49.374607+0100","last_clean":"2026-03-07T01:35:49.374607+0100","last_became_active":"2026-03-07T01:32:47.833028+0100","last_became_peered":"2026-03-07T01:32:47.833028+0100","last_unstale":"2026-03-07T01:35:49.374607+0100","last_undegraded":"2026-03-07T01:35:49.374607+0100","last_fullsized":"2026-03-07T01:35:49.374607+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:35:49.374562+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:35:49.374562+0100","last_clean_scrub_stamp":"2026-03-07T01:35:49.374562+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T10:14:47.894132+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027108699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:35:50.420822+0100","last_change":"2026-03-07T01:35:50.420836+0100","last_active":"2026-03-07T01:35:50.420822+0100","last_peered":"2026-03-07T01:35:50.420822+0100","last_clean":"2026-03-07T01:35:50.420822+0100","last_became_active":"2026-03-07T01:32:47.833125+0100","last_became_peered":"2026-03-07T01:32:47.833125+0100","last_unstale":"2026-03-07T01:35:50.420822+0100","last_undegraded":"2026-03-07T01:35:50.420822+0100","last_fullsized":"2026-03-07T01:35:50.420822+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:35:50.420768+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:35:50.420768+0100","last_clean_scrub_stamp":"2026-03-07T01:35:50.420768+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T05:13:36.444793+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039410900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:35:51.466766+0100","last_change":"2026-03-07T01:35:51.466779+0100","last_active":"2026-03-07T01:35:51.466766+0100","last_peered":"2026-03-07T01:35:51.466766+0100","last_clean":"2026-03-07T01:35:51.466766+0100","last_became_active":"2026-03-07T01:32:47.833210+0100","last_became_peered":"2026-03-07T01:32:47.833210+0100","last_unstale":"2026-03-07T01:35:51.466766+0100","last_undegraded":"2026-03-07T01:35:51.466766+0100","last_fullsized":"2026-03-07T01:35:51.466766+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:35:51.466727+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:35:51.466727+0100","last_clean_scrub_stamp":"2026-03-07T01:35:51.466727+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T08:31:13.454614+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036142800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:35:52.446016+0100","last_change":"2026-03-07T01:35:52.446029+0100","last_active":"2026-03-07T01:35:52.446016+0100","last_peered":"2026-03-07T01:35:52.446016+0100","last_clean":"2026-03-07T01:35:52.446016+0100","last_became_active":"2026-03-07T01:32:47.833276+0100","last_became_peered":"2026-03-07T01:32:47.833276+0100","last_unstale":"2026-03-07T01:35:52.446016+0100","last_undegraded":"2026-03-07T01:35:52.446016+0100","last_fullsized":"2026-03-07T01:35:52.446016+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:35:52.445973+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:35:52.445973+0100","last_clean_scrub_stamp":"2026-03-07T01:35:52.445973+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T05:17:57.422708+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021422100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'3","reported_seq":37,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:35:48.062068+0100","last_change":"2026-03-07T01:35:48.062087+0100","last_active":"2026-03-07T01:35:48.062068+0100","last_peered":"2026-03-07T01:35:48.062068+0100","last_clean":"2026-03-07T01:35:48.062068+0100","last_became_active":"2026-03-07T01:32:47.837875+0100","last_became_peered":"2026-03-07T01:32:47.837875+0100","last_unstale":"2026-03-07T01:35:48.062068+0100","last_undegraded":"2026-03-07T01:35:48.062068+0100","last_fullsized":"2026-03-07T01:35:48.062068+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'3","last_scrub_stamp":"2026-03-07T01:35:48.062026+0100","last_deep_scrub":"18'3","last_deep_scrub_stamp":"2026-03-07T01:35:48.062026+0100","last_clean_scrub_stamp":"2026-03-07T01:35:48.062026+0100","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:33:08.016192+0100","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000191418,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:35:49.134286+0100","last_change":"2026-03-07T01:35:49.134297+0100","last_active":"2026-03-07T01:35:49.134286+0100","last_peered":"2026-03-07T01:35:49.134286+0100","last_clean":"2026-03-07T01:35:49.134286+0100","last_became_active":"2026-03-07T01:32:47.839227+0100","last_became_peered":"2026-03-07T01:32:47.839227+0100","last_unstale":"2026-03-07T01:35:49.134286+0100","last_undegraded":"2026-03-07T01:35:49.134286+0100","last_fullsized":"2026-03-07T01:35:49.134286+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:35:49.134242+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:35:49.134242+0100","last_clean_scrub_stamp":"2026-03-07T01:35:49.134242+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T10:37:27.188161+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038883800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:35:48.180875+0100","last_change":"2026-03-07T01:35:48.180889+0100","last_active":"2026-03-07T01:35:48.180875+0100","last_peered":"2026-03-07T01:35:48.180875+0100","last_clean":"2026-03-07T01:35:48.180875+0100","last_became_active":"2026-03-07T01:32:47.838194+0100","last_became_peered":"2026-03-07T01:32:47.838194+0100","last_unstale":"2026-03-07T01:35:48.180875+0100","last_undegraded":"2026-03-07T01:35:48.180875+0100","last_fullsized":"2026-03-07T01:35:48.180875+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-07T01:35:48.180821+0100","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-07T01:35:48.180821+0100","last_clean_scrub_stamp":"2026-03-07T01:35:48.180821+0100","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:33:08.134987+0100","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000262742,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"18'2","reported_seq":37,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:35:53.473533+0100","last_change":"2026-03-07T01:35:53.473554+0100","last_active":"2026-03-07T01:35:53.473533+0100","last_peered":"2026-03-07T01:35:53.473533+0100","last_clean":"2026-03-07T01:35:53.473533+0100","last_became_active":"2026-03-07T01:32:47.833341+0100","last_became_peered":"2026-03-07T01:32:47.833341+0100","last_unstale":"2026-03-07T01:35:53.473533+0100","last_undegraded":"2026-03-07T01:35:53.473533+0100","last_fullsized":"2026-03-07T01:35:53.473533+0100","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'2","last_scrub_stamp":"2026-03-07T01:35:53.473489+0100","last_deep_scrub":"18'2","last_deep_scrub_stamp":"2026-03-07T01:35:53.473489+0100","last_clean_scrub_stamp":"2026-03-07T01:35:53.473489+0100","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T02:37:50.687929+0100","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00024972699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'34","reported_seq":82,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-03-07T01:35:48.378355+0100","last_change":"2026-03-07T01:35:48.378389+0100","last_active":"2026-03-07T01:35:48.378355+0100","last_peered":"2026-03-07T01:35:48.378355+0100","last_clean":"2026-03-07T01:35:48.378355+0100","last_became_active":"2026-03-07T01:32:41.806810+0100","last_became_peered":"2026-03-07T01:32:41.806810+0100","last_unstale":"2026-03-07T01:35:48.378355+0100","last_undegraded":"2026-03-07T01:35:48.378355+0100","last_fullsized":"2026-03-07T01:35:48.378355+0100","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'34","last_scrub_stamp":"2026-03-07T01:35:48.378313+0100","last_deep_scrub":"18'34","last_deep_scrub_stamp":"2026-03-07T01:35:48.378313+0100","last_clean_scrub_stamp":"2026-03-07T01:35:48.378313+0100","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-03-08T07:59:42.975854+0100","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738411,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":26984,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830616,"statfs":{"total":107374182400,"available":107346550784,"internally_reserved":0,"allocated":155648,"data_stored":47741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738411,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27440,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830160,"statfs":{"total":107374182400,"available":107346083840,"internally_reserved":0,"allocated":622592,"data_stored":507040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738411,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27440,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":104830160,"statfs":{"total":107374182400,"available":107346083840,"internally_reserved":0,"allocated":622592,"data_stored":507040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27457988},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-07T01:36:08.437 DEBUG:teuthology.orchestra.run.vm07:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-03-07T01:36:08.742 INFO:teuthology.misc:Shutting down mds daemons... 2026-03-07T01:36:08.742 INFO:teuthology.misc:Shutting down osd daemons... 2026-03-07T01:36:08.742 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-03-07T01:36:08.742 INFO:teuthology.orchestra.run:waiting for 300 2026-03-07T01:36:08.769 INFO:tasks.ceph.osd.0:Stopped 2026-03-07T01:36:08.770 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-03-07T01:36:08.770 INFO:teuthology.orchestra.run:waiting for 300 2026-03-07T01:36:08.835 INFO:tasks.ceph.osd.1:Stopped 2026-03-07T01:36:08.835 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-03-07T01:36:08.835 INFO:teuthology.orchestra.run:waiting for 300 2026-03-07T01:36:08.904 INFO:tasks.ceph.osd.2:Stopped 2026-03-07T01:36:08.904 INFO:teuthology.misc:Shutting down mgr daemons... 2026-03-07T01:36:08.904 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-03-07T01:36:08.904 INFO:teuthology.orchestra.run:waiting for 300 2026-03-07T01:36:08.988 INFO:tasks.ceph.mgr.x:Stopped 2026-03-07T01:36:08.988 INFO:teuthology.misc:Shutting down mon daemons... 2026-03-07T01:36:08.988 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-03-07T01:36:08.988 INFO:teuthology.orchestra.run:waiting for 300 2026-03-07T01:36:08.997 INFO:tasks.ceph.mon.a:Stopped 2026-03-07T01:36:08.997 INFO:tasks.ceph:Checking cluster log for badness... 2026-03-07T01:36:08.998 DEBUG:teuthology.orchestra.run.vm07:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2026-03-07T01:36:09.068 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@vm07.local 2026-03-07T01:36:09.069 DEBUG:teuthology.orchestra.run.vm07:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-03-07T01:36:09.261 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@vm07.local 2026-03-07T01:36:09.261 DEBUG:teuthology.orchestra.run.vm07:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-03-07T01:36:09.355 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@vm07.local 2026-03-07T01:36:09.355 DEBUG:teuthology.orchestra.run.vm07:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-03-07T01:36:09.421 INFO:tasks.ceph:Archiving mon data... 2026-03-07T01:36:09.421 DEBUG:teuthology.misc:Transferring archived files from vm07:/var/lib/ceph/mon/ceph-a to /archive/irq0-2026-03-06_21:40:09-rgw-cobaltcore-storage-v19.2.3-fasttrack-5-none-default-vps/439/data/mon.a.tgz 2026-03-07T01:36:09.421 DEBUG:teuthology.orchestra.run.vm07:> mktemp 2026-03-07T01:36:09.440 INFO:teuthology.orchestra.run.vm07.stdout:/tmp/tmp.Xc0UaxTZjw 2026-03-07T01:36:09.441 DEBUG:teuthology.orchestra.run.vm07:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Xc0UaxTZjw 2026-03-07T01:36:09.533 DEBUG:teuthology.orchestra.run.vm07:> sudo chmod 0666 /tmp/tmp.Xc0UaxTZjw 2026-03-07T01:36:09.621 DEBUG:teuthology.orchestra.remote:vm07:/tmp/tmp.Xc0UaxTZjw is 175KB 2026-03-07T01:36:09.643 DEBUG:teuthology.orchestra.run.vm07:> rm -fr /tmp/tmp.Xc0UaxTZjw 2026-03-07T01:36:09.662 INFO:tasks.ceph:Cleaning ceph cluster... 2026-03-07T01:36:09.662 DEBUG:teuthology.orchestra.run.vm07:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-03-07T01:36:09.788 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-03-07T01:36:09.788 INFO:tasks.ceph:Archiving crash dumps... 2026-03-07T01:36:09.788 DEBUG:teuthology.misc:Transferring archived files from vm07:/var/lib/ceph/crash to /archive/irq0-2026-03-06_21:40:09-rgw-cobaltcore-storage-v19.2.3-fasttrack-5-none-default-vps/439/remote/vm07/crash 2026-03-07T01:36:09.788 DEBUG:teuthology.orchestra.run.vm07:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-03-07T01:36:09.852 INFO:tasks.ceph:Compressing logs... 2026-03-07T01:36:09.852 DEBUG:teuthology.orchestra.run.vm07:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-03-07T01:36:09.918 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.53745.log 2026-03-07T01:36:09.919 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-03-07T01:36:09.919 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-03-07T01:36:09.919 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph.tmp-client.admin.53745.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.53745.log.gz 2026-03-07T01:36:09.920 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-03-07T01:36:09.926 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-03-07T01:36:09.942 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-osd.2.log: 93.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-03-07T01:36:09.942 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57325.log 2026-03-07T01:36:09.942 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-03-07T01:36:09.942 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.57325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57325.log.gz 2026-03-07T01:36:09.943 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-03-07T01:36:09.943 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph.log: 87.4% -- replaced with /var/log/ceph/ceph.log.gz 2026-03-07T01:36:09.943 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57524.log 2026-03-07T01:36:09.949 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-03-07T01:36:09.949 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.57524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57524.log.gz 2026-03-07T01:36:09.953 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57572.log 2026-03-07T01:36:09.953 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph.audit.log: 87.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-03-07T01:36:09.958 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57620.log 2026-03-07T01:36:09.958 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.57572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57572.log.gz 2026-03-07T01:36:09.960 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57751.log 2026-03-07T01:36:09.960 INFO:teuthology.orchestra.run.vm07.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-03-07T01:36:09.960 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.57620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57620.log.gz 2026-03-07T01:36:09.960 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57825.log 2026-03-07T01:36:09.961 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.57751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57751.log.gz 2026-03-07T01:36:09.961 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59267.log 2026-03-07T01:36:09.961 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.57825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57825.log.gz 2026-03-07T01:36:09.962 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59343.log 2026-03-07T01:36:09.962 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.59267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59267.log.gz 2026-03-07T01:36:09.962 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59415.log 2026-03-07T01:36:09.962 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.59343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59343.log.gz 2026-03-07T01:36:09.963 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59440.log 2026-03-07T01:36:09.963 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.59415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59415.log.gz 2026-03-07T01:36:09.963 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59507.log 2026-03-07T01:36:09.964 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.59440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59440.log.gz 2026-03-07T01:36:09.964 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59557.log 2026-03-07T01:36:09.964 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.59507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59507.log.gz 2026-03-07T01:36:09.964 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59607.log 2026-03-07T01:36:09.965 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.59557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59557.log.gz 2026-03-07T01:36:09.965 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59710.log 2026-03-07T01:36:09.965 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.59607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59607.log.gz 2026-03-07T01:36:09.966 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59708.log 2026-03-07T01:36:09.966 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.59710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59710.log.gz 2026-03-07T01:36:09.966 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59713.log 2026-03-07T01:36:09.967 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.59708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59708.log.gz 2026-03-07T01:36:09.967 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59812.log 2026-03-07T01:36:09.967 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.59713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59713.log.gz 2026-03-07T01:36:09.967 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59835.log 2026-03-07T01:36:09.968 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.59812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59812.log.gz 2026-03-07T01:36:09.968 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59883.log 2026-03-07T01:36:09.968 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.59835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59835.log.gz 2026-03-07T01:36:09.968 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59957.log 2026-03-07T01:36:09.969 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.59883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59883.log.gz 2026-03-07T01:36:09.969 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60005.log 2026-03-07T01:36:09.969 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.59957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59957.log.gz 2026-03-07T01:36:09.970 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60033.log 2026-03-07T01:36:09.970 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.60005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60005.log.gz 2026-03-07T01:36:09.970 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60107.log 2026-03-07T01:36:09.971 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.60033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60033.log.gz 2026-03-07T01:36:09.971 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60135.log 2026-03-07T01:36:09.971 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.60107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60107.log.gz 2026-03-07T01:36:09.971 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60203.log 2026-03-07T01:36:09.972 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.60135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60135.log.gz 2026-03-07T01:36:09.972 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60257.log 2026-03-07T01:36:09.972 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.60203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60203.log.gz 2026-03-07T01:36:09.972 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60307.log 2026-03-07T01:36:09.973 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.60257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60257.log.gz 2026-03-07T01:36:09.973 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60357.log 2026-03-07T01:36:09.973 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.60307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60307.log.gz 2026-03-07T01:36:09.974 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93027.log 2026-03-07T01:36:09.974 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.60357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60357.log.gz 2026-03-07T01:36:09.974 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93077.log 2026-03-07T01:36:09.974 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.93027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93027.log.gz 2026-03-07T01:36:09.975 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93127.log 2026-03-07T01:36:09.975 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.93077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93077.log.gz 2026-03-07T01:36:09.975 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93177.log 2026-03-07T01:36:09.976 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.93127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93127.log.gz 2026-03-07T01:36:09.976 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93227.log 2026-03-07T01:36:09.976 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.93177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93177.log.gz 2026-03-07T01:36:09.976 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93277.log 2026-03-07T01:36:09.977 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.93227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93227.log.gz 2026-03-07T01:36:09.977 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93327.log 2026-03-07T01:36:09.977 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.93277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93277.log.gz 2026-03-07T01:36:09.978 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93377.log 2026-03-07T01:36:09.978 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.93327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93327.log.gz 2026-03-07T01:36:09.978 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93427.log 2026-03-07T01:36:09.979 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.93377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93377.log.gz 2026-03-07T01:36:09.979 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93477.log 2026-03-07T01:36:09.979 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.93427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93427.log.gz 2026-03-07T01:36:09.979 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93527.log 2026-03-07T01:36:09.980 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.93477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93477.log.gz 2026-03-07T01:36:09.980 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93577.log 2026-03-07T01:36:09.980 INFO:teuthology.orchestra.run.vm07.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-03-07T01:36:09.980 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.93527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93527.log.gz 2026-03-07T01:36:09.981 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93625.log 2026-03-07T01:36:09.981 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.93577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93577.log.gz 2026-03-07T01:36:09.981 INFO:teuthology.orchestra.run.vm07.stderr:/var/log/ceph/ceph-client.admin.93625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93625.log.gz 2026-03-07T01:36:09.995 INFO:teuthology.orchestra.run.vm07.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-03-07T01:36:10.006 INFO:teuthology.orchestra.run.vm07.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-03-07T01:36:10.008 INFO:teuthology.orchestra.run.vm07.stderr: 2026-03-07T01:36:10.008 INFO:teuthology.orchestra.run.vm07.stderr:real 0m0.100s 2026-03-07T01:36:10.008 INFO:teuthology.orchestra.run.vm07.stderr:user 0m0.138s 2026-03-07T01:36:10.008 INFO:teuthology.orchestra.run.vm07.stderr:sys 0m0.038s 2026-03-07T01:36:10.008 INFO:tasks.ceph:Archiving logs... 2026-03-07T01:36:10.008 DEBUG:teuthology.misc:Transferring archived files from vm07:/var/log/ceph to /archive/irq0-2026-03-06_21:40:09-rgw-cobaltcore-storage-v19.2.3-fasttrack-5-none-default-vps/439/remote/vm07/log 2026-03-07T01:36:10.008 DEBUG:teuthology.orchestra.run.vm07:> sudo tar c -f - -C /var/log/ceph -- . 2026-03-07T01:36:10.085 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-03-07T01:36:10.088 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-03-07T01:36:10.088 DEBUG:teuthology.orchestra.run.vm07:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-03-07T01:36:10.155 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2026-03-07T01:36:10.155 DEBUG:teuthology.orchestra.run.vm07:> 2026-03-07T01:36:10.155 DEBUG:teuthology.orchestra.run.vm07:> for d in ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ; do 2026-03-07T01:36:10.155 DEBUG:teuthology.orchestra.run.vm07:> sudo yum -y remove $d || true 2026-03-07T01:36:10.155 DEBUG:teuthology.orchestra.run.vm07:> done 2026-03-07T01:36:10.375 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:10.392 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:10.392 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repo Size 2026-03-07T01:36:10.392 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:10.392 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:36:10.392 INFO:teuthology.orchestra.run.vm07.stdout: ceph-radosgw x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 39 M 2026-03-07T01:36:10.392 INFO:teuthology.orchestra.run.vm07.stdout:Removing unused dependencies: 2026-03-07T01:36:10.392 INFO:teuthology.orchestra.run.vm07.stdout: mailcap noarch 2.1.49-5.el9.0.2 @baseos 78 k 2026-03-07T01:36:10.392 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:10.392 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:36:10.392 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:10.393 INFO:teuthology.orchestra.run.vm07.stdout:Remove 2 Packages 2026-03-07T01:36:10.393 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:10.393 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 39 M 2026-03-07T01:36:10.393 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:36:10.393 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:36:10.393 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:36:10.393 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:36:10.393 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:36:10.472 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:36:10.493 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 1/2 2026-03-07T01:36:10.493 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:36:10.493 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-03-07T01:36:10.493 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target". 2026-03-07T01:36:10.493 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-radosgw.target". 2026-03-07T01:36:10.493 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:10.496 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-radosgw-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 1/2 2026-03-07T01:36:10.578 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 1/2 2026-03-07T01:36:10.615 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : mailcap-2.1.49-5.el9.0.2.noarch 2/2 2026-03-07T01:36:10.892 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: mailcap-2.1.49-5.el9.0.2.noarch 2/2 2026-03-07T01:36:10.892 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-radosgw-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 1/2 2026-03-07T01:36:10.986 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : mailcap-2.1.49-5.el9.0.2.noarch 2/2 2026-03-07T01:36:10.987 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:10.987 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:36:10.987 INFO:teuthology.orchestra.run.vm07.stdout: ceph-radosgw-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:10.987 INFO:teuthology.orchestra.run.vm07.stdout: mailcap-2.1.49-5.el9.0.2.noarch 2026-03-07T01:36:10.987 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:10.987 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:11.185 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout: ceph-test x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 210 M 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout:Removing unused dependencies: 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout: socat x86_64 1.7.4.1-8.el9 @appstream 1.1 M 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout: xmlstarlet x86_64 1.6.1-20.el9 @appstream 195 k 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout:Remove 3 Packages 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 211 M 2026-03-07T01:36:11.186 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:36:11.189 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:36:11.189 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:36:11.207 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:36:11.207 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:36:11.264 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:36:11.271 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-test-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 1/3 2026-03-07T01:36:11.273 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : socat-1.7.4.1-8.el9.x86_64 2/3 2026-03-07T01:36:11.288 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : xmlstarlet-1.6.1-20.el9.x86_64 3/3 2026-03-07T01:36:11.347 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: xmlstarlet-1.6.1-20.el9.x86_64 3/3 2026-03-07T01:36:11.347 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-test-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 1/3 2026-03-07T01:36:11.347 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 2/3 2026-03-07T01:36:11.396 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 3/3 2026-03-07T01:36:11.396 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:11.396 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:36:11.396 INFO:teuthology.orchestra.run.vm07.stdout: ceph-test-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:11.396 INFO:teuthology.orchestra.run.vm07.stdout: socat-1.7.4.1-8.el9.x86_64 2026-03-07T01:36:11.396 INFO:teuthology.orchestra.run.vm07.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-03-07T01:36:11.396 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:11.396 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:11.608 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout: ceph x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 0 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout:Removing unused dependencies: 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mds x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 7.4 M 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mon x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 18 M 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout: lua x86_64 5.4.4-4.el9 @appstream 593 k 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout: lua-devel x86_64 5.4.4-4.el9 @crb 49 k 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout: luarocks noarch 3.9.2-5.el9 @epel 692 k 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout: unzip x86_64 6.0-59.el9 @baseos 389 k 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout: zip x86_64 3.0-35.el9 @baseos 724 k 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout:Remove 8 Packages 2026-03-07T01:36:11.609 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:11.610 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 28 M 2026-03-07T01:36:11.610 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:36:11.612 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:36:11.612 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:36:11.631 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:36:11.631 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:36:11.671 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:36:11.677 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 1/8 2026-03-07T01:36:11.681 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : luarocks-3.9.2-5.el9.noarch 2/8 2026-03-07T01:36:11.682 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : lua-devel-5.4.4-4.el9.x86_64 3/8 2026-03-07T01:36:11.685 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : zip-3.0-35.el9.x86_64 4/8 2026-03-07T01:36:11.688 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : unzip-6.0-59.el9.x86_64 5/8 2026-03-07T01:36:11.690 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : lua-5.4.4-4.el9.x86_64 6/8 2026-03-07T01:36:11.710 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mds-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 7/8 2026-03-07T01:36:11.710 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:36:11.710 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-03-07T01:36:11.710 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mds.target". 2026-03-07T01:36:11.710 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mds.target". 2026-03-07T01:36:11.710 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:11.711 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-mds-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 7/8 2026-03-07T01:36:11.730 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mds-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 7/8 2026-03-07T01:36:11.755 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mon-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 8/8 2026-03-07T01:36:11.755 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:36:11.755 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-03-07T01:36:11.755 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mon.target". 2026-03-07T01:36:11.755 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mon.target". 2026-03-07T01:36:11.755 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:11.757 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-mon-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 8/8 2026-03-07T01:36:11.843 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mon-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 8/8 2026-03-07T01:36:11.843 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 1/8 2026-03-07T01:36:11.843 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mds-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2/8 2026-03-07T01:36:11.843 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mon-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 3/8 2026-03-07T01:36:11.844 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : lua-5.4.4-4.el9.x86_64 4/8 2026-03-07T01:36:11.844 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 5/8 2026-03-07T01:36:11.844 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 6/8 2026-03-07T01:36:11.844 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : unzip-6.0-59.el9.x86_64 7/8 2026-03-07T01:36:11.891 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : zip-3.0-35.el9.x86_64 8/8 2026-03-07T01:36:11.891 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:11.891 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:36:11.891 INFO:teuthology.orchestra.run.vm07.stdout: ceph-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:11.891 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mds-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:11.891 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mon-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:11.891 INFO:teuthology.orchestra.run.vm07.stdout: lua-5.4.4-4.el9.x86_64 2026-03-07T01:36:11.891 INFO:teuthology.orchestra.run.vm07.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-03-07T01:36:11.891 INFO:teuthology.orchestra.run.vm07.stdout: luarocks-3.9.2-5.el9.noarch 2026-03-07T01:36:11.891 INFO:teuthology.orchestra.run.vm07.stdout: unzip-6.0-59.el9.x86_64 2026-03-07T01:36:11.891 INFO:teuthology.orchestra.run.vm07.stdout: zip-3.0-35.el9.x86_64 2026-03-07T01:36:11.892 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:11.892 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:12.104 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:12.110 INFO:teuthology.orchestra.run.vm07.stdout:==================================================================================================================== 2026-03-07T01:36:12.110 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:36:12.110 INFO:teuthology.orchestra.run.vm07.stdout:==================================================================================================================== 2026-03-07T01:36:12.110 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:36:12.110 INFO:teuthology.orchestra.run.vm07.stdout: ceph-base x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 23 M 2026-03-07T01:36:12.110 INFO:teuthology.orchestra.run.vm07.stdout:Removing dependent packages: 2026-03-07T01:36:12.110 INFO:teuthology.orchestra.run.vm07.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 431 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 3.4 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-cephadm noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph-noarch 803 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-dashboard noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph-noarch 88 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph-noarch 66 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-rook noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph-noarch 563 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: ceph-osd x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 59 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: ceph-volume noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph-noarch 1.4 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: rbd-mirror x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 13 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout:Removing unused dependencies: 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: abseil-cpp x86_64 20211102.0-4.el9 @epel 1.9 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: c-ares x86_64 1.19.1-2.el9_4 @baseos 279 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: ceph-common x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 85 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: ceph-grafana-dashboards noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph-noarch 626 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph-noarch 60 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-modules-core noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph-noarch 1.5 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: ceph-prometheus-alerts noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph-noarch 51 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: ceph-selinux x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 138 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: cryptsetup x86_64 2.7.2-4.el9 @baseos 722 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: flexiblas x86_64 3.0.4-8.el9.0.1 @appstream 68 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: flexiblas-netlib x86_64 3.0.4-8.el9.0.1 @appstream 11 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9.0.1 @appstream 39 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: gperftools-libs x86_64 2.9.1-3.el9 @epel 1.4 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: grpc-data noarch 1.46.7-10.el9 @epel 13 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: ledmon-libs x86_64 1.1.0-3.el9 @baseos 80 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: libcephsqlite x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 425 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: libconfig x86_64 1.7.2-9.el9 @baseos 220 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: libgfortran x86_64 11.5.0-11.el9 @baseos 2.8 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: liboath x86_64 2.6.12-1.el9 @epel 94 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: libquadmath x86_64 11.5.0-11.el9 @baseos 330 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: libradosstriper1 x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 1.6 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: libstoragemgmt x86_64 1.10.1-1.el9 @appstream 685 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: libunwind x86_64 1.6.2-1.el9 @epel 170 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: libxslt x86_64 1.1.34-13.el9_6 @appstream 751 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: nvme-cli x86_64 2.13-1.el9 @baseos 6.8 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: openblas x86_64 0.3.29-1.el9 @appstream 112 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: openblas-openmp x86_64 0.3.29-1.el9 @appstream 46 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: pciutils x86_64 3.7.0-7.el9 @baseos 216 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: protobuf x86_64 3.14.0-17.el9_7 @appstream 3.5 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: protobuf-compiler x86_64 3.14.0-17.el9_7 @crb 2.9 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-asyncssh noarch 2.13.2-5.el9 @epel 3.9 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-autocommand noarch 2.2.2-8.el9 @epel 82 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-babel noarch 2.9.1-2.el9 @appstream 27 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 @epel 254 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-bcrypt x86_64 3.2.2-1.el9 @epel 87 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-cachetools noarch 4.2.4-1.el9 @epel 93 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-ceph-common x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 702 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-certifi noarch 2023.05.07-4.el9 @epel 6.3 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-cffi x86_64 1.14.5-5.el9 @baseos 1.0 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-chardet noarch 4.0.0-5.el9 @77d52b2cce1347aa9f3fc60d8b93d222 1.4 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-cheroot noarch 10.0.1-4.el9 @epel 682 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-cherrypy noarch 18.6.1-2.el9 @epel 1.1 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-cryptography x86_64 36.0.1-5.el9_6 @baseos 4.5 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-devel x86_64 3.9.23-2.el9 @appstream 765 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-google-auth noarch 1:2.45.0-1.el9 @epel 1.4 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-grpcio x86_64 1.46.7-10.el9 @epel 6.7 M 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 @epel 418 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-idna noarch 2.10-7.el9_4.1 @77d52b2cce1347aa9f3fc60d8b93d222 513 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-influxdb noarch 5.3.1-1.el9 @epel 747 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-isodate noarch 0.6.1-3.el9 @epel 203 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco noarch 8.2.1-3.el9 @epel 3.7 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 @epel 24 k 2026-03-07T01:36:12.111 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 @epel 55 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-context noarch 6.0.1-3.el9 @epel 31 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 @epel 33 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-text noarch 4.0.0-2.el9 @epel 51 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-jinja2 noarch 2.11.3-8.el9_5 @appstream 1.1 M 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-jsonpatch noarch 1.21-16.el9 @0d57cd3fe20446e8b1c08da162742194 55 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-jsonpointer noarch 2.0-4.el9.0.1 @0d57cd3fe20446e8b1c08da162742194 34 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 @epel 21 M 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 @appstream 832 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-logutils noarch 0.3.5-21.el9 @epel 126 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-lxml x86_64 4.6.5-3.el9 @appstream 4.2 M 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-mako noarch 1.1.4-6.el9 @appstream 534 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-markupsafe x86_64 1.1.1-12.el9 @appstream 60 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-more-itertools noarch 8.12.0-2.el9 @epel 378 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-msgpack x86_64 1.0.3-2.el9 @epel 264 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-natsort noarch 7.1.1-5.el9 @epel 215 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-numpy x86_64 1:1.23.5-1.el9 @appstream 30 M 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-numpy-f2py x86_64 1:1.23.5-1.el9 @appstream 1.7 M 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-oauthlib noarch 3.1.1-5.el9 @0d57cd3fe20446e8b1c08da162742194 888 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-packaging noarch 20.9-5.el9 @appstream 248 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-pecan noarch 1.4.2-3.el9 @epel 1.3 M 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-ply noarch 3.11-14.el9.0.1 @baseos 430 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-portend noarch 3.1.0-2.el9 @epel 20 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-prettytable noarch 0.7.2-27.el9.0.1 @0d57cd3fe20446e8b1c08da162742194 166 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-protobuf noarch 3.14.0-17.el9_7 @appstream 1.4 M 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 @epel 389 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyasn1 noarch 0.4.8-7.el9_7 @appstream 622 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9_7 @appstream 1.0 M 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-pycparser noarch 2.20-6.el9 @baseos 745 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyparsing noarch 2.4.7-9.el9.0.1 @baseos 635 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-pysocks noarch 1.7.1-12.el9.0.1 @77d52b2cce1347aa9f3fc60d8b93d222 88 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-pytz noarch 2021.1-5.el9 @0d57cd3fe20446e8b1c08da162742194 176 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-repoze-lru noarch 0.7-16.el9 @epel 83 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-requests noarch 2.25.1-10.el9_6 @baseos 405 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 @appstream 119 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-routes noarch 2.5.1-5.el9 @epel 459 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-rsa noarch 4.9-2.el9 @epel 202 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-saml noarch 1.16.0-1.el9 @epel 730 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-scipy x86_64 1.9.3-2.el9 @appstream 72 M 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-tempora noarch 5.0.0-2.el9 @epel 96 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-toml noarch 0.10.2-6.el9.0.1 @appstream 99 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-typing-extensions noarch 4.15.0-1.el9 @epel 447 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-urllib3 noarch 1.26.5-6.el9_7.1 @baseos 746 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-webob noarch 1.8.8-2.el9 @epel 1.2 M 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-websocket-client noarch 1.2.3-2.el9 @epel 319 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 @epel 1.9 M 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-xmlsec x86_64 1.3.13-1.el9 @epel 158 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: python3-zc-lockfile noarch 2.0-10.el9 @epel 35 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: qatlib x86_64 24.09.0-1.el9 @appstream 588 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: qatlib-service x86_64 24.09.0-1.el9 @appstream 64 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: qatzip-libs x86_64 1.3.1-1.el9 @appstream 148 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: smartmontools x86_64 1:7.2-9.el9 @baseos 1.9 M 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: xmlsec1 x86_64 1.2.29-13.el9 @appstream 596 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 @appstream 281 k 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout:==================================================================================================================== 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout:Remove 116 Packages 2026-03-07T01:36:12.112 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:12.113 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 626 M 2026-03-07T01:36:12.113 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:36:12.137 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:36:12.137 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:36:12.245 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:36:12.246 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:36:12.420 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:36:12.420 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-mgr-rook-2:19.2.3-39.g340d3c24fc6.el9.clyso 1/116 2026-03-07T01:36:12.429 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-39.g340d3c24fc6.el9.clyso 1/116 2026-03-07T01:36:12.448 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mgr-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 2/116 2026-03-07T01:36:12.448 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:36:12.448 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-03-07T01:36:12.448 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mgr.target". 2026-03-07T01:36:12.448 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mgr.target". 2026-03-07T01:36:12.448 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:12.449 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-mgr-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 2/116 2026-03-07T01:36:12.463 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mgr-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 2/116 2026-03-07T01:36:12.493 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-mgr-modules-core-2:19.2.3-39.g340d3c24fc6.e 3/116 2026-03-07T01:36:12.493 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-mgr-dashboard-2:19.2.3-39.g340d3c24fc6.el9. 4/116 2026-03-07T01:36:12.509 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-39.g340d3c24fc6.el9. 4/116 2026-03-07T01:36:12.515 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-influxdb-5.3.1-1.el9.noarch 5/116 2026-03-07T01:36:12.515 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-mgr-cephadm-2:19.2.3-39.g340d3c24fc6.el9.cl 6/116 2026-03-07T01:36:12.529 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-39.g340d3c24fc6.el9.cl 6/116 2026-03-07T01:36:12.535 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-cherrypy-18.6.1-2.el9.noarch 7/116 2026-03-07T01:36:12.540 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-cheroot-10.0.1-4.el9.noarch 8/116 2026-03-07T01:36:12.550 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/116 2026-03-07T01:36:12.554 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-grpcio-1.46.7-10.el9.x86_64 10/116 2026-03-07T01:36:12.576 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-osd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 11/116 2026-03-07T01:36:12.576 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:36:12.576 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-03-07T01:36:12.576 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-osd.target". 2026-03-07T01:36:12.576 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-osd.target". 2026-03-07T01:36:12.576 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:12.582 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-osd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 11/116 2026-03-07T01:36:12.592 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-osd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 11/116 2026-03-07T01:36:12.608 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-volume-2:19.2.3-39.g340d3c24fc6.el9.clyso.n 12/116 2026-03-07T01:36:12.608 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:36:12.608 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-03-07T01:36:12.608 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:12.616 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-volume-2:19.2.3-39.g340d3c24fc6.el9.clyso.n 12/116 2026-03-07T01:36:12.627 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-volume-2:19.2.3-39.g340d3c24fc6.el9.clyso.n 12/116 2026-03-07T01:36:12.630 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-jaraco-collections-3.0.0-8.el9.noarch 13/116 2026-03-07T01:36:12.635 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-jaraco-text-4.0.0-2.el9.noarch 14/116 2026-03-07T01:36:12.639 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-jinja2-2.11.3-8.el9_5.noarch 15/116 2026-03-07T01:36:12.651 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-saml-1.16.0-1.el9.noarch 16/116 2026-03-07T01:36:12.681 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-pecan-1.4.2-3.el9.noarch 17/116 2026-03-07T01:36:12.689 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-babel-2.9.1-2.el9.noarch 18/116 2026-03-07T01:36:12.692 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-jaraco-classes-3.2.1-5.el9.noarch 19/116 2026-03-07T01:36:12.702 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-pyOpenSSL-21.0.0-1.el9.noarch 20/116 2026-03-07T01:36:12.715 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-asyncssh-2.13.2-5.el9.noarch 21/116 2026-03-07T01:36:12.715 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-mgr-diskprediction-local-2:19.2.3-39.g340d3 22/116 2026-03-07T01:36:12.723 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-39.g340d3 22/116 2026-03-07T01:36:12.818 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-jsonpatch-1.21-16.el9.noarch 23/116 2026-03-07T01:36:12.835 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-scipy-1.9.3-2.el9.x86_64 24/116 2026-03-07T01:36:12.842 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-xmlsec-1.3.13-1.el9.x86_64 25/116 2026-03-07T01:36:12.846 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-lxml-4.6.5-3.el9.x86_64 26/116 2026-03-07T01:36:12.861 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 27/116 2026-03-07T01:36:12.861 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/multi-user.target.wants/libstoragemgmt.service". 2026-03-07T01:36:12.861 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:12.863 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libstoragemgmt-1.10.1-1.el9.x86_64 27/116 2026-03-07T01:36:12.890 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 27/116 2026-03-07T01:36:12.896 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-numpy-f2py-1:1.23.5-1.el9.x86_64 28/116 2026-03-07T01:36:12.898 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : xmlsec1-openssl-1.2.29-13.el9.x86_64 29/116 2026-03-07T01:36:12.912 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : xmlsec1-1.2.29-13.el9.x86_64 30/116 2026-03-07T01:36:12.918 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-cryptography-36.0.1-5.el9_6.x86_64 31/116 2026-03-07T01:36:12.921 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : protobuf-compiler-3.14.0-17.el9_7.x86_64 32/116 2026-03-07T01:36:12.923 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-bcrypt-3.2.2-1.el9.x86_64 33/116 2026-03-07T01:36:12.943 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: rbd-mirror-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 34/116 2026-03-07T01:36:12.943 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:36:12.943 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-03-07T01:36:12.943 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target". 2026-03-07T01:36:12.943 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target". 2026-03-07T01:36:12.943 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:12.944 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : rbd-mirror-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 34/116 2026-03-07T01:36:12.957 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: rbd-mirror-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 34/116 2026-03-07T01:36:12.962 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-mako-1.1.4-6.el9.noarch 35/116 2026-03-07T01:36:12.966 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-jaraco-context-6.0.1-3.el9.noarch 36/116 2026-03-07T01:36:12.969 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-packaging-20.9-5.el9.noarch 37/116 2026-03-07T01:36:12.971 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-portend-3.1.0-2.el9.noarch 38/116 2026-03-07T01:36:12.974 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-tempora-5.0.0-2.el9.noarch 39/116 2026-03-07T01:36:12.978 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-jaraco-functools-3.5.0-2.el9.noarch 40/116 2026-03-07T01:36:12.980 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-routes-2.5.1-5.el9.noarch 41/116 2026-03-07T01:36:12.980 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-mgr-k8sevents-2:19.2.3-39.g340d3c24fc6.el9. 42/116 2026-03-07T01:36:13.035 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-39.g340d3c24fc6.el9. 42/116 2026-03-07T01:36:13.044 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-kubernetes-1:26.1.0-3.el9.noarch 43/116 2026-03-07T01:36:13.048 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-requests-oauthlib-1.3.0-12.el9.noarch 44/116 2026-03-07T01:36:13.057 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-requests-2.25.1-10.el9_6.noarch 45/116 2026-03-07T01:36:13.062 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-google-auth-1:2.45.0-1.el9.noarch 46/116 2026-03-07T01:36:13.071 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-rsa-4.9-2.el9.noarch 47/116 2026-03-07T01:36:13.078 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-pyasn1-modules-0.4.8-7.el9_7.noarch 48/116 2026-03-07T01:36:13.082 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-urllib3-1.26.5-6.el9_7.1.noarch 49/116 2026-03-07T01:36:13.087 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-cffi-1.14.5-5.el9.x86_64 50/116 2026-03-07T01:36:13.134 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-pycparser-2.20-6.el9.noarch 51/116 2026-03-07T01:36:13.145 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-numpy-1:1.23.5-1.el9.x86_64 52/116 2026-03-07T01:36:13.149 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : flexiblas-netlib-3.0.4-8.el9.0.1.x86_64 53/116 2026-03-07T01:36:13.154 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : flexiblas-openblas-openmp-3.0.4-8.el9.0.1.x86_64 54/116 2026-03-07T01:36:13.157 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : openblas-openmp-0.3.29-1.el9.x86_64 55/116 2026-03-07T01:36:13.161 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libgfortran-11.5.0-11.el9.x86_64 56/116 2026-03-07T01:36:13.163 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 57/116 2026-03-07T01:36:13.181 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-39.g340d3c2 58/116 2026-03-07T01:36:13.181 INFO:teuthology.orchestra.run.vm07.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-07T01:36:13.182 INFO:teuthology.orchestra.run.vm07.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-03-07T01:36:13.182 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:13.182 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-immutable-object-cache-2:19.2.3-39.g340d3c2 58/116 2026-03-07T01:36:13.189 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-39.g340d3c2 58/116 2026-03-07T01:36:13.191 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : openblas-0.3.29-1.el9.x86_64 59/116 2026-03-07T01:36:13.194 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : flexiblas-3.0.4-8.el9.0.1.x86_64 60/116 2026-03-07T01:36:13.197 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-ply-3.11-14.el9.0.1.noarch 61/116 2026-03-07T01:36:13.200 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-idna-2.10-7.el9_4.1.noarch 62/116 2026-03-07T01:36:13.205 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-pysocks-1.7.1-12.el9.0.1.noarch 63/116 2026-03-07T01:36:13.209 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-pyasn1-0.4.8-7.el9_7.noarch 64/116 2026-03-07T01:36:13.214 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-cachetools-4.2.4-1.el9.noarch 65/116 2026-03-07T01:36:13.223 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-chardet-4.0.0-5.el9.noarch 66/116 2026-03-07T01:36:13.229 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-oauthlib-3.1.1-5.el9.noarch 67/116 2026-03-07T01:36:13.233 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-websocket-client-1.2.3-2.el9.noarch 68/116 2026-03-07T01:36:13.236 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-certifi-2023.05.07-4.el9.noarch 69/116 2026-03-07T01:36:13.238 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-repoze-lru-0.7-16.el9.noarch 70/116 2026-03-07T01:36:13.240 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-jaraco-8.2.1-3.el9.noarch 71/116 2026-03-07T01:36:13.243 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-more-itertools-8.12.0-2.el9.noarch 72/116 2026-03-07T01:36:13.246 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-toml-0.10.2-6.el9.0.1.noarch 73/116 2026-03-07T01:36:13.249 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-pytz-2021.1-5.el9.noarch 74/116 2026-03-07T01:36:13.252 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-pyparsing-2.4.7-9.el9.0.1.noarch 75/116 2026-03-07T01:36:13.259 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-backports-tarfile-1.2.0-1.el9.noarch 76/116 2026-03-07T01:36:13.264 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-devel-3.9.23-2.el9.x86_64 77/116 2026-03-07T01:36:13.266 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-jsonpointer-2.0-4.el9.0.1.noarch 78/116 2026-03-07T01:36:13.269 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-typing-extensions-4.15.0-1.el9.noarch 79/116 2026-03-07T01:36:13.275 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-logutils-0.3.5-21.el9.noarch 80/116 2026-03-07T01:36:13.280 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-webob-1.8.8-2.el9.noarch 81/116 2026-03-07T01:36:13.283 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-isodate-0.6.1-3.el9.noarch 82/116 2026-03-07T01:36:13.285 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-autocommand-2.2.2-8.el9.noarch 83/116 2026-03-07T01:36:13.291 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : grpc-data-1.46.7-10.el9.noarch 84/116 2026-03-07T01:36:13.295 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-protobuf-3.14.0-17.el9_7.noarch 85/116 2026-03-07T01:36:13.299 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-zc-lockfile-2.0-10.el9.noarch 86/116 2026-03-07T01:36:13.301 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-natsort-7.1.1-5.el9.noarch 87/116 2026-03-07T01:36:13.303 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-grafana-dashboards-2:19.2.3-39.g340d3c24fc6 88/116 2026-03-07T01:36:13.309 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-prometheus-alerts-2:19.2.3-39.g340d3c24fc6. 89/116 2026-03-07T01:36:13.313 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-werkzeug-2.0.3-3.el9.1.noarch 90/116 2026-03-07T01:36:13.336 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-base-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 91/116 2026-03-07T01:36:13.336 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-03-07T01:36:13.336 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-crash.service". 2026-03-07T01:36:13.336 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:13.345 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-base-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 91/116 2026-03-07T01:36:13.345 INFO:teuthology.orchestra.run.vm07.stdout:warning: file /etc/logrotate.d/ceph: remove failed: No such file or directory 2026-03-07T01:36:13.345 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:13.374 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-base-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 91/116 2026-03-07T01:36:13.375 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-common-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 92/116 2026-03-07T01:36:13.391 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-common-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 92/116 2026-03-07T01:36:13.396 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : qatzip-libs-1.3.1-1.el9.x86_64 93/116 2026-03-07T01:36:13.399 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-ceph-common-2:19.2.3-39.g340d3c24fc6.el9 94/116 2026-03-07T01:36:13.401 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-prettytable-0.7.2-27.el9.0.1.noarch 95/116 2026-03-07T01:36:13.401 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-selinux-2:19.2.3-39.g340d3c24fc6.el9.clyso. 96/116 2026-03-07T01:36:19.069 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: ceph-selinux-2:19.2.3-39.g340d3c24fc6.el9.clyso. 96/116 2026-03-07T01:36:19.069 INFO:teuthology.orchestra.run.vm07.stdout:skipping the directory /sys 2026-03-07T01:36:19.069 INFO:teuthology.orchestra.run.vm07.stdout:skipping the directory /proc 2026-03-07T01:36:19.069 INFO:teuthology.orchestra.run.vm07.stdout:skipping the directory /mnt 2026-03-07T01:36:19.069 INFO:teuthology.orchestra.run.vm07.stdout:skipping the directory /var/tmp 2026-03-07T01:36:19.069 INFO:teuthology.orchestra.run.vm07.stdout:skipping the directory /home 2026-03-07T01:36:19.070 INFO:teuthology.orchestra.run.vm07.stdout:skipping the directory /root 2026-03-07T01:36:19.070 INFO:teuthology.orchestra.run.vm07.stdout:skipping the directory /tmp 2026-03-07T01:36:19.070 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:19.079 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : qatlib-24.09.0-1.el9.x86_64 97/116 2026-03-07T01:36:19.102 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: qatlib-service-24.09.0-1.el9.x86_64 98/116 2026-03-07T01:36:19.103 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : qatlib-service-24.09.0-1.el9.x86_64 98/116 2026-03-07T01:36:19.112 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: qatlib-service-24.09.0-1.el9.x86_64 98/116 2026-03-07T01:36:19.115 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : gperftools-libs-2.9.1-3.el9.x86_64 99/116 2026-03-07T01:36:19.117 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libunwind-1.6.2-1.el9.x86_64 100/116 2026-03-07T01:36:19.120 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : pciutils-3.7.0-7.el9.x86_64 101/116 2026-03-07T01:36:19.121 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : liboath-2.6.12-1.el9.x86_64 102/116 2026-03-07T01:36:19.122 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libradosstriper1-2:19.2.3-39.g340d3c24fc6.el9.cl 103/116 2026-03-07T01:36:19.156 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libradosstriper1-2:19.2.3-39.g340d3c24fc6.el9.cl 103/116 2026-03-07T01:36:19.162 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : nvme-cli-2.13-1.el9.x86_64 104/116 2026-03-07T01:36:19.176 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: smartmontools-1:7.2-9.el9.x86_64 105/116 2026-03-07T01:36:19.176 INFO:teuthology.orchestra.run.vm07.stdout:Removed "/etc/systemd/system/multi-user.target.wants/smartd.service". 2026-03-07T01:36:19.176 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:19.178 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : smartmontools-1:7.2-9.el9.x86_64 105/116 2026-03-07T01:36:19.186 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: smartmontools-1:7.2-9.el9.x86_64 105/116 2026-03-07T01:36:19.189 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ledmon-libs-1.1.0-3.el9.x86_64 106/116 2026-03-07T01:36:19.191 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libquadmath-11.5.0-11.el9.x86_64 107/116 2026-03-07T01:36:19.195 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-markupsafe-1.1.1-12.el9.x86_64 108/116 2026-03-07T01:36:19.198 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : protobuf-3.14.0-17.el9_7.x86_64 109/116 2026-03-07T01:36:19.201 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libxslt-1.1.34-13.el9_6.x86_64 110/116 2026-03-07T01:36:19.207 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libconfig-1.7.2-9.el9.x86_64 111/116 2026-03-07T01:36:19.215 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : cryptsetup-2.7.2-4.el9.x86_64 112/116 2026-03-07T01:36:19.221 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : abseil-cpp-20211102.0-4.el9.x86_64 113/116 2026-03-07T01:36:19.223 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : c-ares-1.19.1-2.el9_4.x86_64 114/116 2026-03-07T01:36:19.227 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-msgpack-1.0.3-2.el9.x86_64 115/116 2026-03-07T01:36:19.227 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libcephsqlite-2:19.2.3-39.g340d3c24fc6.el9.clyso 116/116 2026-03-07T01:36:19.326 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libcephsqlite-2:19.2.3-39.g340d3c24fc6.el9.clyso 116/116 2026-03-07T01:36:19.326 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 1/116 2026-03-07T01:36:19.326 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : c-ares-1.19.1-2.el9_4.x86_64 2/116 2026-03-07T01:36:19.326 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-base-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 3/116 2026-03-07T01:36:19.326 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-common-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 4/116 2026-03-07T01:36:19.326 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-39.g340d3c24fc6 5/116 2026-03-07T01:36:19.326 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-39.g340d3c2 6/116 2026-03-07T01:36:19.326 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mgr-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 7/116 2026-03-07T01:36:19.326 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-39.g340d3c24fc6.el9.cl 8/116 2026-03-07T01:36:19.326 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-39.g340d3c24fc6.el9. 9/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-39.g340d3 10/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-39.g340d3c24fc6.el9. 11/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-39.g340d3c24fc6.e 12/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-mgr-rook-2:19.2.3-39.g340d3c24fc6.el9.clyso 13/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-osd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_ 14/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-39.g340d3c24fc6. 15/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-selinux-2:19.2.3-39.g340d3c24fc6.el9.clyso. 16/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-volume-2:19.2.3-39.g340d3c24fc6.el9.clyso.n 17/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : cryptsetup-2.7.2-4.el9.x86_64 18/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : flexiblas-3.0.4-8.el9.0.1.x86_64 19/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.0.1.x86_64 20/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.0.1.x86_64 21/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 22/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 23/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 24/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libcephsqlite-2:19.2.3-39.g340d3c24fc6.el9.clyso 25/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 26/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libgfortran-11.5.0-11.el9.x86_64 27/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libquadmath-11.5.0-11.el9.x86_64 29/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libradosstriper1-2:19.2.3-39.g340d3c24fc6.el9.cl 30/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 31/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libxslt-1.1.34-13.el9_6.x86_64 33/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 34/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 37/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : protobuf-3.14.0-17.el9_7.x86_64 38/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : protobuf-compiler-3.14.0-17.el9_7.x86_64 39/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 40/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 41/116 2026-03-07T01:36:19.327 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 42/116 2026-03-07T01:36:19.328 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 43/116 2026-03-07T01:36:19.328 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 44/116 2026-03-07T01:36:19.328 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 45/116 2026-03-07T01:36:19.328 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-ceph-common-2:19.2.3-39.g340d3c24fc6.el9 46/116 2026-03-07T01:36:19.328 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 47/116 2026-03-07T01:36:19.328 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 48/116 2026-03-07T01:36:19.328 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-chardet-4.0.0-5.el9.noarch 49/116 2026-03-07T01:36:19.328 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 50/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 51/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-cryptography-36.0.1-5.el9_6.x86_64 52/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-devel-3.9.23-2.el9.x86_64 53/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 54/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 55/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 56/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-idna-2.10-7.el9_4.1.noarch 57/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 58/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 59/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 60/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 61/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 62/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 63/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 64/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 65/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jinja2-2.11.3-8.el9_5.noarch 66/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-jsonpointer-2.0-4.el9.0.1.noarch 68/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 69/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 70/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 71/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 72/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 73/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 74/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 75/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 76/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 77/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-numpy-1:1.23.5-1.el9.x86_64 78/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-numpy-f2py-1:1.23.5-1.el9.x86_64 79/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 82/116 2026-03-07T01:36:19.329 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-ply-3.11-14.el9.0.1.noarch 83/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-prettytable-0.7.2-27.el9.0.1.noarch 85/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-protobuf-3.14.0-17.el9_7.noarch 86/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-pyasn1-0.4.8-7.el9_7.noarch 88/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9_7.noarch 89/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.0.1.noarch 91/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-pysocks-1.7.1-12.el9.0.1.noarch 92/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 93/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 94/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-requests-2.25.1-10.el9_6.noarch 95/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 97/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 98/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 99/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 100/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 101/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-toml-0.10.2-6.el9.0.1.noarch 102/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 103/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-urllib3-1.26.5-6.el9_7.1.noarch 104/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 105/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 106/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 107/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 108/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 109/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : qatlib-24.09.0-1.el9.x86_64 110/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : qatlib-service-24.09.0-1.el9.x86_64 111/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 112/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : rbd-mirror-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 113/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : smartmontools-1:7.2-9.el9.x86_64 114/116 2026-03-07T01:36:19.330 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 115/116 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 116/116 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout: c-ares-1.19.1-2.el9_4.x86_64 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout: ceph-base-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout: ceph-common-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout: ceph-grafana-dashboards-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout: ceph-immutable-object-cache-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-cephadm-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-dashboard-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-diskprediction-local-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-k8sevents-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:36:19.408 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-modules-core-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: ceph-mgr-rook-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: ceph-osd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: ceph-prometheus-alerts-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: ceph-selinux-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: ceph-volume-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: cryptsetup-2.7.2-4.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: flexiblas-3.0.4-8.el9.0.1.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: flexiblas-netlib-3.0.4-8.el9.0.1.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.0.1.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: grpc-data-1.46.7-10.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: libcephsqlite-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: libconfig-1.7.2-9.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: libgfortran-11.5.0-11.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: liboath-2.6.12-1.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: libquadmath-11.5.0-11.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: libradosstriper1-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: libunwind-1.6.2-1.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: libxslt-1.1.34-13.el9_6.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: nvme-cli-2.13-1.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: openblas-0.3.29-1.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: pciutils-3.7.0-7.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: protobuf-3.14.0-17.el9_7.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: protobuf-compiler-3.14.0-17.el9_7.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-babel-2.9.1-2.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-ceph-common-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-chardet-4.0.0-5.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-cryptography-36.0.1-5.el9_6.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-devel-3.9.23-2.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-idna-2.10-7.el9_4.1.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-jinja2-2.11.3-8.el9_5.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-jsonpatch-1.21-16.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-jsonpointer-2.0-4.el9.0.1.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-03-07T01:36:19.409 INFO:teuthology.orchestra.run.vm07.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-mako-1.1.4-6.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-numpy-1:1.23.5-1.el9.x86_64 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-numpy-f2py-1:1.23.5-1.el9.x86_64 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-packaging-20.9-5.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-ply-3.11-14.el9.0.1.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-portend-3.1.0-2.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-prettytable-0.7.2-27.el9.0.1.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-protobuf-3.14.0-17.el9_7.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyasn1-0.4.8-7.el9_7.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyasn1-modules-0.4.8-7.el9_7.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-pycparser-2.20-6.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-pyparsing-2.4.7-9.el9.0.1.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-pysocks-1.7.1-12.el9.0.1.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-pytz-2021.1-5.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-requests-2.25.1-10.el9_6.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-routes-2.5.1-5.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-rsa-4.9-2.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-saml-1.16.0-1.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-toml-0.10.2-6.el9.0.1.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-urllib3-1.26.5-6.el9_7.1.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-webob-1.8.8-2.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: qatlib-24.09.0-1.el9.x86_64 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: qatlib-service-24.09.0-1.el9.x86_64 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: rbd-mirror-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: smartmontools-1:7.2-9.el9.x86_64 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:19.410 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:19.640 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:19.640 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:19.640 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:36:19.640 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:19.640 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:36:19.640 INFO:teuthology.orchestra.run.vm07.stdout: cephadm noarch 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph-noarch 775 k 2026-03-07T01:36:19.640 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:19.640 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:36:19.640 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:19.641 INFO:teuthology.orchestra.run.vm07.stdout:Remove 1 Package 2026-03-07T01:36:19.641 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:19.641 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 775 k 2026-03-07T01:36:19.641 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:36:19.643 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:36:19.643 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:36:19.644 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:36:19.644 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:36:19.663 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:36:19.664 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : cephadm-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 1/1 2026-03-07T01:36:19.798 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: cephadm-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 1/1 2026-03-07T01:36:19.834 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : cephadm-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 1/1 2026-03-07T01:36:19.835 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:19.835 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:36:19.835 INFO:teuthology.orchestra.run.vm07.stdout: cephadm-2:19.2.3-39.g340d3c24fc6.el9.clyso.noarch 2026-03-07T01:36:19.835 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:19.835 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:20.005 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: ceph-immutable-object-cache 2026-03-07T01:36:20.005 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:20.008 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:20.009 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:20.009 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:20.179 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: ceph-mgr 2026-03-07T01:36:20.179 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:20.182 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:20.182 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:20.182 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:20.353 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: ceph-mgr-dashboard 2026-03-07T01:36:20.353 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:20.355 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:20.356 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:20.356 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:20.512 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: ceph-mgr-diskprediction-local 2026-03-07T01:36:20.512 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:20.514 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:20.515 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:20.515 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:20.676 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: ceph-mgr-rook 2026-03-07T01:36:20.676 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:20.679 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:20.679 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:20.679 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:20.846 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: ceph-mgr-cephadm 2026-03-07T01:36:20.847 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:20.849 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:20.850 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:20.850 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:21.025 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:21.026 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:21.026 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:36:21.026 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:21.026 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:36:21.026 INFO:teuthology.orchestra.run.vm07.stdout: ceph-fuse x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 3.6 M 2026-03-07T01:36:21.026 INFO:teuthology.orchestra.run.vm07.stdout:Removing unused dependencies: 2026-03-07T01:36:21.026 INFO:teuthology.orchestra.run.vm07.stdout: fuse x86_64 2.9.9-17.el9 @baseos 213 k 2026-03-07T01:36:21.026 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:21.026 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:36:21.026 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:21.026 INFO:teuthology.orchestra.run.vm07.stdout:Remove 2 Packages 2026-03-07T01:36:21.026 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:21.026 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 3.8 M 2026-03-07T01:36:21.026 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:36:21.028 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:36:21.028 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:36:21.041 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:36:21.041 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:36:21.070 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:36:21.073 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : ceph-fuse-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 1/2 2026-03-07T01:36:21.087 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : fuse-2.9.9-17.el9.x86_64 2/2 2026-03-07T01:36:21.153 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: fuse-2.9.9-17.el9.x86_64 2/2 2026-03-07T01:36:21.153 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : ceph-fuse-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 1/2 2026-03-07T01:36:21.194 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : fuse-2.9.9-17.el9.x86_64 2/2 2026-03-07T01:36:21.194 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:21.194 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:36:21.194 INFO:teuthology.orchestra.run.vm07.stdout: ceph-fuse-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 fuse-2.9.9-17.el9.x86_64 2026-03-07T01:36:21.194 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:21.194 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:21.394 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: ceph-volume 2026-03-07T01:36:21.395 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:21.397 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:21.397 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:21.397 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:21.602 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:21.602 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:21.602 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repo Size 2026-03-07T01:36:21.602 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:21.602 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:36:21.602 INFO:teuthology.orchestra.run.vm07.stdout: librados-devel x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 456 k 2026-03-07T01:36:21.602 INFO:teuthology.orchestra.run.vm07.stdout:Removing dependent packages: 2026-03-07T01:36:21.602 INFO:teuthology.orchestra.run.vm07.stdout: libcephfs-devel x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 153 k 2026-03-07T01:36:21.603 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:21.603 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:36:21.603 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:21.603 INFO:teuthology.orchestra.run.vm07.stdout:Remove 2 Packages 2026-03-07T01:36:21.603 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:21.603 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 610 k 2026-03-07T01:36:21.603 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:36:21.604 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:36:21.604 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:36:21.615 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:36:21.615 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:36:21.639 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:36:21.641 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libcephfs-devel-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 1/2 2026-03-07T01:36:21.654 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : librados-devel-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 2/2 2026-03-07T01:36:21.717 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: librados-devel-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 2/2 2026-03-07T01:36:21.717 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libcephfs-devel-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 1/2 2026-03-07T01:36:21.760 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : librados-devel-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 2/2 2026-03-07T01:36:21.761 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:21.761 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:36:21.761 INFO:teuthology.orchestra.run.vm07.stdout: libcephfs-devel-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:21.761 INFO:teuthology.orchestra.run.vm07.stdout: librados-devel-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:21.761 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:21.761 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:21.938 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:21.938 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:21.938 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repo Size 2026-03-07T01:36:21.938 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:21.938 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:36:21.938 INFO:teuthology.orchestra.run.vm07.stdout: libcephfs2 x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 3.0 M 2026-03-07T01:36:21.939 INFO:teuthology.orchestra.run.vm07.stdout:Removing dependent packages: 2026-03-07T01:36:21.939 INFO:teuthology.orchestra.run.vm07.stdout: python3-cephfs x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 514 k 2026-03-07T01:36:21.939 INFO:teuthology.orchestra.run.vm07.stdout:Removing unused dependencies: 2026-03-07T01:36:21.939 INFO:teuthology.orchestra.run.vm07.stdout: python3-ceph-argparse x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 187 k 2026-03-07T01:36:21.939 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:21.939 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:36:21.939 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:21.939 INFO:teuthology.orchestra.run.vm07.stdout:Remove 3 Packages 2026-03-07T01:36:21.939 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:21.939 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 3.7 M 2026-03-07T01:36:21.939 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:36:21.941 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:36:21.941 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:36:21.953 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:36:21.953 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:36:21.984 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:36:21.986 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-cephfs-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 1/3 2026-03-07T01:36:21.988 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-ceph-argparse-2:19.2.3-39.g340d3c24fc6.el9.c 2/3 2026-03-07T01:36:21.988 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libcephfs2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 3/3 2026-03-07T01:36:22.052 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: libcephfs2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 3/3 2026-03-07T01:36:22.052 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libcephfs2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 1/3 2026-03-07T01:36:22.052 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-ceph-argparse-2:19.2.3-39.g340d3c24fc6.el9.c 2/3 2026-03-07T01:36:22.090 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-cephfs-2:19.2.3-39.g340d3c24fc6.el9.clyso.x8 3/3 2026-03-07T01:36:22.091 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:22.091 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:36:22.091 INFO:teuthology.orchestra.run.vm07.stdout: libcephfs2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:22.091 INFO:teuthology.orchestra.run.vm07.stdout: python3-ceph-argparse-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:22.091 INFO:teuthology.orchestra.run.vm07.stdout: python3-cephfs-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:22.091 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:22.091 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:22.264 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: libcephfs-devel 2026-03-07T01:36:22.264 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:22.267 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:22.267 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:22.267 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:22.449 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:22.450 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:22.450 INFO:teuthology.orchestra.run.vm07.stdout: Package Arch Version Repository Size 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout:Removing: 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: librados2 x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 13 M 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout:Removing dependent packages: 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: python3-rados x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 1.1 M 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: python3-rbd x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 1.1 M 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: python3-rgw x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 265 k 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: qemu-kvm-block-rbd x86_64 17:9.1.0-29.el9_7.6 @appstream 41 k 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: rbd-fuse x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 227 k 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: rbd-nbd x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 494 k 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout:Removing unused dependencies: 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: boost-program-options 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: x86_64 1.75.0-13.el9_7 @appstream 276 k 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: libarrow x86_64 9.0.0-15.el9 @epel 18 M 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: libarrow-doc noarch 9.0.0-15.el9 @epel 122 k 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: libnbd x86_64 1.20.3-4.el9 @appstream 461 k 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: libpmemobj x86_64 1.12.1-1.el9 @appstream 383 k 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: librabbitmq x86_64 0.11.0-7.el9 @appstream 102 k 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: librbd1 x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 13 M 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: librdkafka x86_64 1.6.1-102.el9 @appstream 2.0 M 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: librgw2 x86_64 2:19.2.3-39.g340d3c24fc6.el9.clyso @ceph 19 M 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: lmdb-libs x86_64 0.9.29-3.el9 @baseos 106 k 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: lttng-ust x86_64 2.12.0-6.el9 @appstream 1.0 M 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: parquet-libs x86_64 9.0.0-15.el9 @epel 2.8 M 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: re2 x86_64 1:20211101-20.el9 @epel 472 k 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: thrift x86_64 0.15.0-4.el9 @epel 4.8 M 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout:Transaction Summary 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout:================================================================================ 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout:Remove 21 Packages 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout:Freed space: 79 M 2026-03-07T01:36:22.451 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction check 2026-03-07T01:36:22.455 INFO:teuthology.orchestra.run.vm07.stdout:Transaction check succeeded. 2026-03-07T01:36:22.455 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction test 2026-03-07T01:36:22.471 INFO:teuthology.orchestra.run.vm07.stdout:Transaction test succeeded. 2026-03-07T01:36:22.471 INFO:teuthology.orchestra.run.vm07.stdout:Running transaction 2026-03-07T01:36:22.508 INFO:teuthology.orchestra.run.vm07.stdout: Preparing : 1/1 2026-03-07T01:36:22.510 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : rbd-nbd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 1/21 2026-03-07T01:36:22.512 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : rbd-fuse-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2/21 2026-03-07T01:36:22.515 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-rgw-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 3/21 2026-03-07T01:36:22.515 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : librgw2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 4/21 2026-03-07T01:36:22.528 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: librgw2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 4/21 2026-03-07T01:36:22.530 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : parquet-libs-9.0.0-15.el9.x86_64 5/21 2026-03-07T01:36:22.532 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-rbd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 6/21 2026-03-07T01:36:22.533 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : python3-rados-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 7/21 2026-03-07T01:36:22.535 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : qemu-kvm-block-rbd-17:9.1.0-29.el9_7.6.x86_64 8/21 2026-03-07T01:36:22.538 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libarrow-doc-9.0.0-15.el9.noarch 9/21 2026-03-07T01:36:22.538 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : librbd1-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 10/21 2026-03-07T01:36:22.551 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: librbd1-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 10/21 2026-03-07T01:36:22.551 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : librados2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_6 11/21 2026-03-07T01:36:22.551 INFO:teuthology.orchestra.run.vm07.stdout:warning: file /etc/ceph: remove failed: No such file or directory 2026-03-07T01:36:22.551 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:22.564 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: librados2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_6 11/21 2026-03-07T01:36:22.566 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libarrow-9.0.0-15.el9.x86_64 12/21 2026-03-07T01:36:22.569 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : re2-1:20211101-20.el9.x86_64 13/21 2026-03-07T01:36:22.573 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : lttng-ust-2.12.0-6.el9.x86_64 14/21 2026-03-07T01:36:22.575 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : thrift-0.15.0-4.el9.x86_64 15/21 2026-03-07T01:36:22.578 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libnbd-1.20.3-4.el9.x86_64 16/21 2026-03-07T01:36:22.580 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : libpmemobj-1.12.1-1.el9.x86_64 17/21 2026-03-07T01:36:22.581 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : boost-program-options-1.75.0-13.el9_7.x86_64 18/21 2026-03-07T01:36:22.583 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : lmdb-libs-0.9.29-3.el9.x86_64 19/21 2026-03-07T01:36:22.586 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : librabbitmq-0.11.0-7.el9.x86_64 20/21 2026-03-07T01:36:22.600 INFO:teuthology.orchestra.run.vm07.stdout: Erasing : librdkafka-1.6.1-102.el9.x86_64 21/21 2026-03-07T01:36:22.655 INFO:teuthology.orchestra.run.vm07.stdout: Running scriptlet: librdkafka-1.6.1-102.el9.x86_64 21/21 2026-03-07T01:36:22.655 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : boost-program-options-1.75.0-13.el9_7.x86_64 1/21 2026-03-07T01:36:22.655 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 2/21 2026-03-07T01:36:22.655 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 3/21 2026-03-07T01:36:22.655 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 4/21 2026-03-07T01:36:22.655 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 5/21 2026-03-07T01:36:22.655 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 6/21 2026-03-07T01:36:22.655 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : librados2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_6 7/21 2026-03-07T01:36:22.655 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : librbd1-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 8/21 2026-03-07T01:36:22.655 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 9/21 2026-03-07T01:36:22.655 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : librgw2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 10/21 2026-03-07T01:36:22.656 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : lmdb-libs-0.9.29-3.el9.x86_64 11/21 2026-03-07T01:36:22.656 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 12/21 2026-03-07T01:36:22.656 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 13/21 2026-03-07T01:36:22.656 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-rados-2:19.2.3-39.g340d3c24fc6.el9.clyso.x 14/21 2026-03-07T01:36:22.656 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-rbd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 15/21 2026-03-07T01:36:22.656 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : python3-rgw-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86 16/21 2026-03-07T01:36:22.656 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : qemu-kvm-block-rbd-17:9.1.0-29.el9_7.6.x86_64 17/21 2026-03-07T01:36:22.656 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : rbd-fuse-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 18/21 2026-03-07T01:36:22.656 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : rbd-nbd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 19/21 2026-03-07T01:36:22.656 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : re2-1:20211101-20.el9.x86_64 20/21 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 21/21 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout:Removed: 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: boost-program-options-1.75.0-13.el9_7.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: libarrow-9.0.0-15.el9.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: libnbd-1.20.3-4.el9.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: librados2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: librbd1-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: librgw2-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: lmdb-libs-0.9.29-3.el9.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: python3-rados-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: python3-rbd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: python3-rgw-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: qemu-kvm-block-rbd-17:9.1.0-29.el9_7.6.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: rbd-fuse-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: rbd-nbd-2:19.2.3-39.g340d3c24fc6.el9.clyso.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: re2-1:20211101-20.el9.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: thrift-0.15.0-4.el9.x86_64 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout: 2026-03-07T01:36:22.707 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:22.911 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: librbd1 2026-03-07T01:36:22.911 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:22.914 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:22.914 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:22.914 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:23.109 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: python3-rados 2026-03-07T01:36:23.109 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:23.112 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:23.113 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:23.113 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:23.303 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: python3-rgw 2026-03-07T01:36:23.304 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:23.307 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:23.307 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:23.307 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:23.483 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: python3-cephfs 2026-03-07T01:36:23.483 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:23.485 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:23.486 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:23.486 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:23.649 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: python3-rbd 2026-03-07T01:36:23.649 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:23.652 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:23.653 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:23.653 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:23.827 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: rbd-fuse 2026-03-07T01:36:23.827 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:23.829 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:23.830 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:23.830 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:23.996 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: rbd-mirror 2026-03-07T01:36:23.996 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:23.999 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:23.999 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:23.999 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:24.173 INFO:teuthology.orchestra.run.vm07.stdout:No match for argument: rbd-nbd 2026-03-07T01:36:24.174 INFO:teuthology.orchestra.run.vm07.stderr:No packages marked for removal. 2026-03-07T01:36:24.176 INFO:teuthology.orchestra.run.vm07.stdout:Dependencies resolved. 2026-03-07T01:36:24.177 INFO:teuthology.orchestra.run.vm07.stdout:Nothing to do. 2026-03-07T01:36:24.177 INFO:teuthology.orchestra.run.vm07.stdout:Complete! 2026-03-07T01:36:24.200 DEBUG:teuthology.orchestra.run.vm07:> sudo yum clean all 2026-03-07T01:36:24.338 INFO:teuthology.orchestra.run.vm07.stdout:62 files removed 2026-03-07T01:36:24.362 DEBUG:teuthology.orchestra.run.vm07:> sudo rm /etc/yum.repos.d/ceph-source.repo 2026-03-07T01:36:24.392 DEBUG:teuthology.orchestra.run.vm07:> sudo rm /etc/yum.repos.d/ceph-noarch.repo 2026-03-07T01:36:24.461 DEBUG:teuthology.orchestra.run.vm07:> sudo rm /etc/yum.repos.d/ceph.repo 2026-03-07T01:36:24.535 DEBUG:teuthology.orchestra.run.vm07:> sudo yum clean expire-cache 2026-03-07T01:36:24.692 INFO:teuthology.orchestra.run.vm07.stdout:Cache was expired 2026-03-07T01:36:24.693 INFO:teuthology.orchestra.run.vm07.stdout:0 files removed 2026-03-07T01:36:24.715 DEBUG:teuthology.parallel:result is None 2026-03-07T01:36:24.715 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@vm07.local 2026-03-07T01:36:24.715 DEBUG:teuthology.orchestra.run.vm07:> sudo rm -f /etc/yum.repos.d/ceph.repo 2026-03-07T01:36:24.741 DEBUG:teuthology.orchestra.run.vm07:> sudo mv -f /etc/yum/pluginconf.d/priorities.conf.orig /etc/yum/pluginconf.d/priorities.conf 2026-03-07T01:36:24.809 INFO:teuthology.orchestra.run.vm07.stderr:mv: cannot stat '/etc/yum/pluginconf.d/priorities.conf.orig': No such file or directory 2026-03-07T01:36:24.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-07T01:36:24.810 DEBUG:teuthology.parallel:result is None 2026-03-07T01:36:24.811 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-03-07T01:36:24.813 INFO:teuthology.task.clock:Checking final clock skew... 2026-03-07T01:36:24.813 DEBUG:teuthology.orchestra.run.vm07:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-07T01:36:24.868 INFO:teuthology.orchestra.run.vm07.stderr:bash: line 1: ntpq: command not found 2026-03-07T01:36:24.872 INFO:teuthology.orchestra.run.vm07.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-07T01:36:24.872 INFO:teuthology.orchestra.run.vm07.stdout:=============================================================================== 2026-03-07T01:36:24.872 INFO:teuthology.orchestra.run.vm07.stdout:^+ 104-167-24-26.lunoxia.fc> 2 6 377 40 +1726us[+1726us] +/- 40ms 2026-03-07T01:36:24.872 INFO:teuthology.orchestra.run.vm07.stdout:^* sv1.ggsrv.de 2 6 377 41 -894us[ -759us] +/- 18ms 2026-03-07T01:36:24.872 INFO:teuthology.orchestra.run.vm07.stdout:^+ where-you.at 2 6 377 40 -649us[ -649us] +/- 35ms 2026-03-07T01:36:24.872 INFO:teuthology.orchestra.run.vm07.stdout:^+ 172-236-195-26.ip.linode> 3 6 377 40 +881us[ +881us] +/- 21ms 2026-03-07T01:36:24.872 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-03-07T01:36:24.874 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-03-07T01:36:24.875 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-03-07T01:36:24.877 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-03-07T01:36:24.879 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-03-07T01:36:24.881 INFO:teuthology.task.internal:Duration was 453.536983 seconds 2026-03-07T01:36:24.881 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-03-07T01:36:24.883 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-03-07T01:36:24.883 DEBUG:teuthology.orchestra.run.vm07:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-03-07T01:36:24.953 INFO:teuthology.orchestra.run.vm07.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-07T01:36:25.086 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-03-07T01:36:25.086 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@vm07.local 2026-03-07T01:36:25.086 DEBUG:teuthology.orchestra.run.vm07:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-03-07T01:36:25.153 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-03-07T01:36:25.153 DEBUG:teuthology.orchestra.run.vm07:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-03-07T01:36:25.608 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-03-07T01:36:25.608 DEBUG:teuthology.orchestra.run.vm07:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-03-07T01:36:25.634 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-07T01:36:25.635 INFO:teuthology.orchestra.run.vm07.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-07T01:36:25.635 INFO:teuthology.orchestra.run.vm07.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-03-07T01:36:25.635 INFO:teuthology.orchestra.run.vm07.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-03-07T01:36:25.635 INFO:teuthology.orchestra.run.vm07.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-03-07T01:36:25.785 INFO:teuthology.orchestra.run.vm07.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 98.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-03-07T01:36:25.787 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-03-07T01:36:25.789 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-03-07T01:36:25.789 DEBUG:teuthology.orchestra.run.vm07:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-03-07T01:36:25.853 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-03-07T01:36:25.864 DEBUG:teuthology.orchestra.run.vm07:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-03-07T01:36:25.920 INFO:teuthology.orchestra.run.vm07.stdout:kernel.core_pattern = core 2026-03-07T01:36:25.933 DEBUG:teuthology.orchestra.run.vm07:> test -e /home/ubuntu/cephtest/archive/coredump 2026-03-07T01:36:25.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-07T01:36:25.989 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-03-07T01:36:25.991 INFO:teuthology.task.internal:Transferring archived files... 2026-03-07T01:36:25.992 DEBUG:teuthology.misc:Transferring archived files from vm07:/home/ubuntu/cephtest/archive to /archive/irq0-2026-03-06_21:40:09-rgw-cobaltcore-storage-v19.2.3-fasttrack-5-none-default-vps/439/remote/vm07 2026-03-07T01:36:25.992 DEBUG:teuthology.orchestra.run.vm07:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-03-07T01:36:26.057 INFO:teuthology.task.internal:Removing archive directory... 2026-03-07T01:36:26.057 DEBUG:teuthology.orchestra.run.vm07:> rm -rf -- /home/ubuntu/cephtest/archive 2026-03-07T01:36:26.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-03-07T01:36:26.118 INFO:teuthology.task.internal:Not uploading archives. 2026-03-07T01:36:26.118 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-03-07T01:36:26.120 INFO:teuthology.task.internal:Tidying up after the test... 2026-03-07T01:36:26.121 DEBUG:teuthology.orchestra.run.vm07:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-03-07T01:36:26.172 INFO:teuthology.orchestra.run.vm07.stdout: 83886506 0 drwxr-xr-x 2 ubuntu ubuntu 6 Mar 7 01:36 /home/ubuntu/cephtest 2026-03-07T01:36:26.173 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-03-07T01:36:26.181 INFO:teuthology.run:Summary data: description: rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides rocky_latest s3tests-branch tasks/s3/{auth-order/external-local s3tests}} duration: 453.5369827747345 failure_reason: 'Command failed on vm07 with status 1: ''cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack ec2 credentials create --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://vm07.local:5000/v3 --project s3tests --user s3tests-main --debug''' flavor: default owner: irq0 sentry_event: null status: fail success: false 2026-03-07T01:36:26.181 DEBUG:teuthology.report:Pushing job info to http://localhost:8080 2026-03-07T01:36:26.198 INFO:teuthology.run:FAIL