2026-03-09T15:27:53.107 INFO:root:teuthology version: 1.2.4.dev6+g1c580df7a 2026-03-09T15:27:53.111 DEBUG:teuthology.report:Pushing job info to http://localhost:8080 2026-03-09T15:27:53.129 INFO:teuthology.run:Config: archive_path: /archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/526 branch: squid description: orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_ca_signed_key} email: null first_in_suite: false flavor: default job_id: '526' last_in_suite: false machine_type: vps name: kyr-2026-03-09_11:23:05-orch-squid-none-default-vps no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ansible.cephlab: branch: main skip_tags: nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs vars: timezone: UTC ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: true mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd mclock iops capacity threshold hdd: 49000 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-only-match: - CEPHADM_ sha1: e911bdebe5c8faa3800735d1568fcdca65db60df ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: use-ca-signed-key: true install: ceph: flavor: default sha1: e911bdebe5c8faa3800735d1568fcdca65db60df extra_system_packages: deb: - python3-xmltodict - python3-jmespath rpm: - bzip2 - perl-Test-Harness - python3-xmltodict - python3-jmespath selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 workunit: branch: tt-squid sha1: 569c3e99c9b32a51b4eaf08731c728f4513ed589 owner: kyr priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - host.a - mon.a - mgr.a - osd.0 - client.0 - - host.b - mon.b - mgr.b - osd.1 - client.1 seed: 3443 sha1: e911bdebe5c8faa3800735d1568fcdca65db60df sleep_before_teardown: 0 subset: 1/64 suite: orch suite_branch: tt-squid suite_path: /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa suite_relpath: qa suite_repo: https://github.com/kshtsk/ceph.git suite_sha1: 569c3e99c9b32a51b4eaf08731c728f4513ed589 targets: vm03.local: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGNLD5UpzS0v3GxYIZth4aXElgBQx8IIF5ZGIylht5wKQunVQzYbmw9YLMCXhce768O7r2JizMHoaXc1BBNg4Jw= vm04.local: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGRSIXjGyp5/FHvRd1Lf7le4GnqDizFCobqZSh4Rla5VZRf20tuxkve0WPg3ZkLYI4sH06BVgzYEl51Hbo5rqT4= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: null - cephadm: null - cephadm.shell: host.a: - "set -ex\nHOSTNAMES=$(ceph orch host ls --format json | jq -r '.[] | .hostname')\n\ for host in $HOSTNAMES; do\n # do a check-host on each host to make sure it's\ \ reachable\n ceph cephadm check-host ${host} 2> ${host}-ok.txt\n HOST_OK=$(cat\ \ ${host}-ok.txt)\n if ! grep -q \"Host looks OK\" <<< \"$HOST_OK\"; then\n\ \ printf \"Failed host check:\\n\\n$HOST_OK\"\n exit 1\n fi\ndone\n" teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: clyso-debian-13 teuthology_repo: https://github.com/clyso/teuthology teuthology_sha1: 1c580df7a9c7c2aadc272da296344fd99f27c444 timestamp: 2026-03-09_11:23:05 tube: vps user: kyr verbose: false worker_log: /home/teuthos/.teuthology/dispatcher/dispatcher.vps.611473 2026-03-09T15:27:53.129 INFO:teuthology.run:suite_path is set to /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa; will attempt to use it 2026-03-09T15:27:53.130 INFO:teuthology.run:Found tasks at /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa/tasks 2026-03-09T15:27:53.130 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-03-09T15:27:53.130 INFO:teuthology.task.internal:Checking packages... 2026-03-09T15:27:53.130 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e911bdebe5c8faa3800735d1568fcdca65db60df' 2026-03-09T15:27:53.130 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-03-09T15:27:53.130 INFO:teuthology.packaging:ref: None 2026-03-09T15:27:53.130 INFO:teuthology.packaging:tag: None 2026-03-09T15:27:53.130 INFO:teuthology.packaging:branch: squid 2026-03-09T15:27:53.130 INFO:teuthology.packaging:sha1: e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T15:27:53.130 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2026-03-09T15:27:53.895 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-678.ge911bdeb 2026-03-09T15:27:53.896 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-03-09T15:27:53.897 INFO:teuthology.task.internal:no buildpackages task found 2026-03-09T15:27:53.897 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-03-09T15:27:53.897 INFO:teuthology.task.internal:Saving configuration 2026-03-09T15:27:53.901 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-03-09T15:27:53.901 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-03-09T15:27:53.911 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'vm03.local', 'description': '/archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/526', 'up': True, 'machine_type': 'vps', 'is_vm': True, 'vm_host': {'name': 'localhost', 'description': None, 'up': True, 'machine_type': 'libvirt', 'is_vm': False, 'vm_host': None, 'os_type': None, 'os_version': None, 'arch': None, 'locked': True, 'locked_since': None, 'locked_by': None, 'mac_address': None, 'ssh_pub_key': None}, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-03-09 15:26:39.462176', 'locked_by': 'kyr', 'mac_address': '52:55:00:00:00:03', 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGNLD5UpzS0v3GxYIZth4aXElgBQx8IIF5ZGIylht5wKQunVQzYbmw9YLMCXhce768O7r2JizMHoaXc1BBNg4Jw='} 2026-03-09T15:27:53.916 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'vm04.local', 'description': '/archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/526', 'up': True, 'machine_type': 'vps', 'is_vm': True, 'vm_host': {'name': 'localhost', 'description': None, 'up': True, 'machine_type': 'libvirt', 'is_vm': False, 'vm_host': None, 'os_type': None, 'os_version': None, 'arch': None, 'locked': True, 'locked_since': None, 'locked_by': None, 'mac_address': None, 'ssh_pub_key': None}, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-03-09 15:26:39.462638', 'locked_by': 'kyr', 'mac_address': '52:55:00:00:00:04', 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGRSIXjGyp5/FHvRd1Lf7le4GnqDizFCobqZSh4Rla5VZRf20tuxkve0WPg3ZkLYI4sH06BVgzYEl51Hbo5rqT4='} 2026-03-09T15:27:53.916 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-03-09T15:27:53.917 INFO:teuthology.task.internal:roles: ubuntu@vm03.local - ['host.a', 'mon.a', 'mgr.a', 'osd.0', 'client.0'] 2026-03-09T15:27:53.917 INFO:teuthology.task.internal:roles: ubuntu@vm04.local - ['host.b', 'mon.b', 'mgr.b', 'osd.1', 'client.1'] 2026-03-09T15:27:53.917 INFO:teuthology.run_tasks:Running task console_log... 2026-03-09T15:27:53.924 DEBUG:teuthology.task.console_log:vm03 does not support IPMI; excluding 2026-03-09T15:27:53.930 DEBUG:teuthology.task.console_log:vm04 does not support IPMI; excluding 2026-03-09T15:27:53.930 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4a0c082170>, signals=[15]) 2026-03-09T15:27:53.930 INFO:teuthology.run_tasks:Running task internal.connect... 2026-03-09T15:27:53.931 INFO:teuthology.task.internal:Opening connections... 2026-03-09T15:27:53.931 DEBUG:teuthology.task.internal:connecting to ubuntu@vm03.local 2026-03-09T15:27:53.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm03.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-09T15:27:53.989 DEBUG:teuthology.task.internal:connecting to ubuntu@vm04.local 2026-03-09T15:27:53.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm04.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-09T15:27:54.049 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-03-09T15:27:54.051 DEBUG:teuthology.orchestra.run.vm03:> uname -m 2026-03-09T15:27:54.081 INFO:teuthology.orchestra.run.vm03.stdout:x86_64 2026-03-09T15:27:54.082 DEBUG:teuthology.orchestra.run.vm03:> cat /etc/os-release 2026-03-09T15:27:54.135 INFO:teuthology.orchestra.run.vm03.stdout:NAME="CentOS Stream" 2026-03-09T15:27:54.136 INFO:teuthology.orchestra.run.vm03.stdout:VERSION="9" 2026-03-09T15:27:54.136 INFO:teuthology.orchestra.run.vm03.stdout:ID="centos" 2026-03-09T15:27:54.136 INFO:teuthology.orchestra.run.vm03.stdout:ID_LIKE="rhel fedora" 2026-03-09T15:27:54.136 INFO:teuthology.orchestra.run.vm03.stdout:VERSION_ID="9" 2026-03-09T15:27:54.136 INFO:teuthology.orchestra.run.vm03.stdout:PLATFORM_ID="platform:el9" 2026-03-09T15:27:54.136 INFO:teuthology.orchestra.run.vm03.stdout:PRETTY_NAME="CentOS Stream 9" 2026-03-09T15:27:54.136 INFO:teuthology.orchestra.run.vm03.stdout:ANSI_COLOR="0;31" 2026-03-09T15:27:54.136 INFO:teuthology.orchestra.run.vm03.stdout:LOGO="fedora-logo-icon" 2026-03-09T15:27:54.136 INFO:teuthology.orchestra.run.vm03.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-03-09T15:27:54.136 INFO:teuthology.orchestra.run.vm03.stdout:HOME_URL="https://centos.org/" 2026-03-09T15:27:54.136 INFO:teuthology.orchestra.run.vm03.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-03-09T15:27:54.136 INFO:teuthology.orchestra.run.vm03.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-03-09T15:27:54.136 INFO:teuthology.orchestra.run.vm03.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-03-09T15:27:54.136 INFO:teuthology.lock.ops:Updating vm03.local on lock server 2026-03-09T15:27:54.141 DEBUG:teuthology.orchestra.run.vm04:> uname -m 2026-03-09T15:27:54.156 INFO:teuthology.orchestra.run.vm04.stdout:x86_64 2026-03-09T15:27:54.156 DEBUG:teuthology.orchestra.run.vm04:> cat /etc/os-release 2026-03-09T15:27:54.212 INFO:teuthology.orchestra.run.vm04.stdout:NAME="CentOS Stream" 2026-03-09T15:27:54.212 INFO:teuthology.orchestra.run.vm04.stdout:VERSION="9" 2026-03-09T15:27:54.212 INFO:teuthology.orchestra.run.vm04.stdout:ID="centos" 2026-03-09T15:27:54.212 INFO:teuthology.orchestra.run.vm04.stdout:ID_LIKE="rhel fedora" 2026-03-09T15:27:54.212 INFO:teuthology.orchestra.run.vm04.stdout:VERSION_ID="9" 2026-03-09T15:27:54.212 INFO:teuthology.orchestra.run.vm04.stdout:PLATFORM_ID="platform:el9" 2026-03-09T15:27:54.212 INFO:teuthology.orchestra.run.vm04.stdout:PRETTY_NAME="CentOS Stream 9" 2026-03-09T15:27:54.212 INFO:teuthology.orchestra.run.vm04.stdout:ANSI_COLOR="0;31" 2026-03-09T15:27:54.212 INFO:teuthology.orchestra.run.vm04.stdout:LOGO="fedora-logo-icon" 2026-03-09T15:27:54.212 INFO:teuthology.orchestra.run.vm04.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-03-09T15:27:54.212 INFO:teuthology.orchestra.run.vm04.stdout:HOME_URL="https://centos.org/" 2026-03-09T15:27:54.212 INFO:teuthology.orchestra.run.vm04.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-03-09T15:27:54.212 INFO:teuthology.orchestra.run.vm04.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-03-09T15:27:54.212 INFO:teuthology.orchestra.run.vm04.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-03-09T15:27:54.212 INFO:teuthology.lock.ops:Updating vm04.local on lock server 2026-03-09T15:27:54.216 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-03-09T15:27:54.218 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-03-09T15:27:54.218 INFO:teuthology.task.internal:Checking for old test directory... 2026-03-09T15:27:54.218 DEBUG:teuthology.orchestra.run.vm03:> test '!' -e /home/ubuntu/cephtest 2026-03-09T15:27:54.220 DEBUG:teuthology.orchestra.run.vm04:> test '!' -e /home/ubuntu/cephtest 2026-03-09T15:27:54.268 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-03-09T15:27:54.269 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-03-09T15:27:54.269 DEBUG:teuthology.orchestra.run.vm03:> test -z $(ls -A /var/lib/ceph) 2026-03-09T15:27:54.273 DEBUG:teuthology.orchestra.run.vm04:> test -z $(ls -A /var/lib/ceph) 2026-03-09T15:27:54.285 INFO:teuthology.orchestra.run.vm03.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-03-09T15:27:54.325 INFO:teuthology.orchestra.run.vm04.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-03-09T15:27:54.325 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-03-09T15:27:54.332 DEBUG:teuthology.orchestra.run.vm03:> test -e /ceph-qa-ready 2026-03-09T15:27:54.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T15:27:54.526 DEBUG:teuthology.orchestra.run.vm04:> test -e /ceph-qa-ready 2026-03-09T15:27:54.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T15:27:54.716 INFO:teuthology.run_tasks:Running task internal.base... 2026-03-09T15:27:54.717 INFO:teuthology.task.internal:Creating test directory... 2026-03-09T15:27:54.717 DEBUG:teuthology.orchestra.run.vm03:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-03-09T15:27:54.719 DEBUG:teuthology.orchestra.run.vm04:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-03-09T15:27:54.733 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-03-09T15:27:54.734 INFO:teuthology.run_tasks:Running task internal.archive... 2026-03-09T15:27:54.735 INFO:teuthology.task.internal:Creating archive directory... 2026-03-09T15:27:54.736 DEBUG:teuthology.orchestra.run.vm03:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-03-09T15:27:54.775 DEBUG:teuthology.orchestra.run.vm04:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-03-09T15:27:54.791 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-03-09T15:27:54.792 INFO:teuthology.task.internal:Enabling coredump saving... 2026-03-09T15:27:54.792 DEBUG:teuthology.orchestra.run.vm03:> test -f /run/.containerenv -o -f /.dockerenv 2026-03-09T15:27:54.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T15:27:54.841 DEBUG:teuthology.orchestra.run.vm04:> test -f /run/.containerenv -o -f /.dockerenv 2026-03-09T15:27:54.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T15:27:54.854 DEBUG:teuthology.orchestra.run.vm03:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-03-09T15:27:54.884 DEBUG:teuthology.orchestra.run.vm04:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-03-09T15:27:54.905 INFO:teuthology.orchestra.run.vm03.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-09T15:27:54.913 INFO:teuthology.orchestra.run.vm03.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-09T15:27:54.917 INFO:teuthology.orchestra.run.vm04.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-09T15:27:54.925 INFO:teuthology.orchestra.run.vm04.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-09T15:27:54.926 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-03-09T15:27:54.927 INFO:teuthology.task.internal:Configuring sudo... 2026-03-09T15:27:54.927 DEBUG:teuthology.orchestra.run.vm03:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-03-09T15:27:54.956 DEBUG:teuthology.orchestra.run.vm04:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-03-09T15:27:54.988 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-03-09T15:27:54.991 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-03-09T15:27:54.991 DEBUG:teuthology.orchestra.run.vm03:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-03-09T15:27:55.018 DEBUG:teuthology.orchestra.run.vm04:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-03-09T15:27:55.042 DEBUG:teuthology.orchestra.run.vm03:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-09T15:27:55.091 DEBUG:teuthology.orchestra.run.vm03:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-09T15:27:55.147 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T15:27:55.147 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-03-09T15:27:55.203 DEBUG:teuthology.orchestra.run.vm04:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-09T15:27:55.224 DEBUG:teuthology.orchestra.run.vm04:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-09T15:27:55.279 DEBUG:teuthology.orchestra.run.vm04:> set -ex 2026-03-09T15:27:55.279 DEBUG:teuthology.orchestra.run.vm04:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-03-09T15:27:55.337 DEBUG:teuthology.orchestra.run.vm03:> sudo service rsyslog restart 2026-03-09T15:27:55.339 DEBUG:teuthology.orchestra.run.vm04:> sudo service rsyslog restart 2026-03-09T15:27:55.363 INFO:teuthology.orchestra.run.vm03.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-09T15:27:55.405 INFO:teuthology.orchestra.run.vm04.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-09T15:27:55.653 INFO:teuthology.run_tasks:Running task internal.timer... 2026-03-09T15:27:55.654 INFO:teuthology.task.internal:Starting timer... 2026-03-09T15:27:55.654 INFO:teuthology.run_tasks:Running task pcp... 2026-03-09T15:27:55.657 INFO:teuthology.run_tasks:Running task selinux... 2026-03-09T15:27:55.659 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-03-09T15:27:55.659 INFO:teuthology.task.selinux:Excluding vm03: VMs are not yet supported 2026-03-09T15:27:55.659 INFO:teuthology.task.selinux:Excluding vm04: VMs are not yet supported 2026-03-09T15:27:55.659 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-03-09T15:27:55.659 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-03-09T15:27:55.659 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-03-09T15:27:55.659 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-03-09T15:27:55.661 DEBUG:teuthology.task:Applying overrides for task ansible.cephlab: {'branch': 'main', 'skip_tags': 'nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs', 'vars': {'timezone': 'UTC'}} 2026-03-09T15:27:55.661 DEBUG:teuthology.repo_utils:Setting repo remote to https://github.com/ceph/ceph-cm-ansible.git 2026-03-09T15:27:55.662 INFO:teuthology.repo_utils:Fetching github.com_ceph_ceph-cm-ansible_main from origin 2026-03-09T15:27:56.270 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthos/src/github.com_ceph_ceph-cm-ansible_main to origin/main 2026-03-09T15:27:56.275 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-03-09T15:27:56.276 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu", "timezone": "UTC"}' -i /tmp/teuth_ansible_inventoryrvktiej7 --limit vm03.local,vm04.local /home/teuthos/src/github.com_ceph_ceph-cm-ansible_main/cephlab.yml --skip-tags nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs 2026-03-09T15:29:46.276 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@vm03.local'), Remote(name='ubuntu@vm04.local')] 2026-03-09T15:29:46.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@vm03.local' 2026-03-09T15:29:46.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm03.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-09T15:29:46.342 DEBUG:teuthology.orchestra.run.vm03:> true 2026-03-09T15:29:46.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@vm03.local' 2026-03-09T15:29:46.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@vm04.local' 2026-03-09T15:29:46.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm04.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-09T15:29:46.489 DEBUG:teuthology.orchestra.run.vm04:> true 2026-03-09T15:29:46.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@vm04.local' 2026-03-09T15:29:46.565 INFO:teuthology.run_tasks:Running task clock... 2026-03-09T15:29:46.568 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-03-09T15:29:46.568 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-03-09T15:29:46.568 DEBUG:teuthology.orchestra.run.vm03:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-09T15:29:46.571 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-03-09T15:29:46.571 DEBUG:teuthology.orchestra.run.vm04:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-09T15:29:46.605 INFO:teuthology.orchestra.run.vm03.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-03-09T15:29:46.625 INFO:teuthology.orchestra.run.vm03.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-03-09T15:29:46.640 INFO:teuthology.orchestra.run.vm04.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-03-09T15:29:46.654 INFO:teuthology.orchestra.run.vm04.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-03-09T15:29:46.662 INFO:teuthology.orchestra.run.vm03.stderr:sudo: ntpd: command not found 2026-03-09T15:29:46.674 INFO:teuthology.orchestra.run.vm03.stdout:506 Cannot talk to daemon 2026-03-09T15:29:46.678 INFO:teuthology.orchestra.run.vm04.stderr:sudo: ntpd: command not found 2026-03-09T15:29:46.690 INFO:teuthology.orchestra.run.vm03.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-03-09T15:29:46.690 INFO:teuthology.orchestra.run.vm04.stdout:506 Cannot talk to daemon 2026-03-09T15:29:46.705 INFO:teuthology.orchestra.run.vm03.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-03-09T15:29:46.706 INFO:teuthology.orchestra.run.vm04.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-03-09T15:29:46.722 INFO:teuthology.orchestra.run.vm04.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-03-09T15:29:46.759 INFO:teuthology.orchestra.run.vm03.stderr:bash: line 1: ntpq: command not found 2026-03-09T15:29:46.766 INFO:teuthology.orchestra.run.vm03.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-09T15:29:46.766 INFO:teuthology.orchestra.run.vm03.stdout:=============================================================================== 2026-03-09T15:29:46.766 INFO:teuthology.orchestra.run.vm03.stdout:^? mail.sassmann.nrw 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T15:29:46.766 INFO:teuthology.orchestra.run.vm03.stdout:^? sonne.floppy.org 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T15:29:46.766 INFO:teuthology.orchestra.run.vm03.stdout:^? 141.144.246.224 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T15:29:46.766 INFO:teuthology.orchestra.run.vm03.stdout:^? ntp3.rrze.uni-erlangen.de 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T15:29:46.769 INFO:teuthology.orchestra.run.vm04.stderr:bash: line 1: ntpq: command not found 2026-03-09T15:29:46.772 INFO:teuthology.orchestra.run.vm04.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-09T15:29:46.772 INFO:teuthology.orchestra.run.vm04.stdout:=============================================================================== 2026-03-09T15:29:46.772 INFO:teuthology.orchestra.run.vm04.stdout:^? mail.sassmann.nrw 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T15:29:46.772 INFO:teuthology.orchestra.run.vm04.stdout:^? 141.144.246.224 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T15:29:46.772 INFO:teuthology.orchestra.run.vm04.stdout:^? sonne.floppy.org 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T15:29:46.772 INFO:teuthology.orchestra.run.vm04.stdout:^? ntp3.rrze.uni-erlangen.de 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-03-09T15:29:46.773 INFO:teuthology.run_tasks:Running task pexec... 2026-03-09T15:29:46.775 INFO:teuthology.task.pexec:Executing custom commands... 2026-03-09T15:29:46.775 DEBUG:teuthology.orchestra.run.vm03:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-03-09T15:29:46.776 DEBUG:teuthology.orchestra.run.vm04:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-03-09T15:29:46.808 DEBUG:teuthology.task.pexec:ubuntu@vm03.local< sudo dnf remove nvme-cli -y 2026-03-09T15:29:46.808 DEBUG:teuthology.task.pexec:ubuntu@vm03.local< sudo dnf install nvmetcli nvme-cli -y 2026-03-09T15:29:46.808 INFO:teuthology.task.pexec:Running commands on host ubuntu@vm03.local 2026-03-09T15:29:46.808 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-03-09T15:29:46.808 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-03-09T15:29:46.815 DEBUG:teuthology.task.pexec:ubuntu@vm04.local< sudo dnf remove nvme-cli -y 2026-03-09T15:29:46.815 DEBUG:teuthology.task.pexec:ubuntu@vm04.local< sudo dnf install nvmetcli nvme-cli -y 2026-03-09T15:29:46.815 INFO:teuthology.task.pexec:Running commands on host ubuntu@vm04.local 2026-03-09T15:29:46.815 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-03-09T15:29:46.815 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-03-09T15:29:47.019 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: nvme-cli 2026-03-09T15:29:47.019 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:29:47.022 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:29:47.022 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:29:47.022 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:29:47.029 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: nvme-cli 2026-03-09T15:29:47.029 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:29:47.035 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:29:47.035 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:29:47.036 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:29:47.476 INFO:teuthology.orchestra.run.vm04.stdout:Last metadata expiration check: 0:01:06 ago on Mon 09 Mar 2026 03:28:41 PM UTC. 2026-03-09T15:29:47.516 INFO:teuthology.orchestra.run.vm03.stdout:Last metadata expiration check: 0:01:07 ago on Mon 09 Mar 2026 03:28:40 PM UTC. 2026-03-09T15:29:47.594 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout: Package Architecture Version Repository Size 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout:Installing: 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout:Installing dependencies: 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout:Transaction Summary 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout:Install 6 Packages 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout:Total download size: 2.3 M 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout:Installed size: 11 M 2026-03-09T15:29:47.596 INFO:teuthology.orchestra.run.vm04.stdout:Downloading Packages: 2026-03-09T15:29:47.631 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout: Package Architecture Version Repository Size 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout:Installing: 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout:Installing dependencies: 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout:Transaction Summary 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout:Install 6 Packages 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout:Total download size: 2.3 M 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout:Installed size: 11 M 2026-03-09T15:29:47.632 INFO:teuthology.orchestra.run.vm03.stdout:Downloading Packages: 2026-03-09T15:29:48.206 INFO:teuthology.orchestra.run.vm03.stdout:(1/6): python3-configshell-1.1.30-1.el9.noarch. 587 kB/s | 72 kB 00:00 2026-03-09T15:29:48.256 INFO:teuthology.orchestra.run.vm03.stdout:(2/6): python3-kmod-0.9-32.el9.x86_64.rpm 1.6 MB/s | 84 kB 00:00 2026-03-09T15:29:48.270 INFO:teuthology.orchestra.run.vm03.stdout:(3/6): nvmetcli-0.8-3.el9.noarch.rpm 234 kB/s | 44 kB 00:00 2026-03-09T15:29:48.280 INFO:teuthology.orchestra.run.vm04.stdout:(1/6): python3-configshell-1.1.30-1.el9.noarch. 480 kB/s | 72 kB 00:00 2026-03-09T15:29:48.286 INFO:teuthology.orchestra.run.vm04.stdout:(2/6): nvmetcli-0.8-3.el9.noarch.rpm 281 kB/s | 44 kB 00:00 2026-03-09T15:29:48.310 INFO:teuthology.orchestra.run.vm03.stdout:(4/6): python3-pyparsing-2.4.7-9.el9.noarch.rpm 2.8 MB/s | 150 kB 00:00 2026-03-09T15:29:48.346 INFO:teuthology.orchestra.run.vm03.stdout:(5/6): nvme-cli-2.16-1.el9.x86_64.rpm 4.4 MB/s | 1.2 MB 00:00 2026-03-09T15:29:48.348 INFO:teuthology.orchestra.run.vm04.stdout:(3/6): python3-pyparsing-2.4.7-9.el9.noarch.rpm 2.4 MB/s | 150 kB 00:00 2026-03-09T15:29:48.379 INFO:teuthology.orchestra.run.vm04.stdout:(4/6): python3-kmod-0.9-32.el9.x86_64.rpm 851 kB/s | 84 kB 00:00 2026-03-09T15:29:48.390 INFO:teuthology.orchestra.run.vm03.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 6.8 MB/s | 837 kB 00:00 2026-03-09T15:29:48.390 INFO:teuthology.orchestra.run.vm03.stdout:-------------------------------------------------------------------------------- 2026-03-09T15:29:48.390 INFO:teuthology.orchestra.run.vm03.stdout:Total 3.1 MB/s | 2.3 MB 00:00 2026-03-09T15:29:48.410 INFO:teuthology.orchestra.run.vm04.stdout:(5/6): nvme-cli-2.16-1.el9.x86_64.rpm 4.1 MB/s | 1.2 MB 00:00 2026-03-09T15:29:48.464 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction check 2026-03-09T15:29:48.471 INFO:teuthology.orchestra.run.vm03.stdout:Transaction check succeeded. 2026-03-09T15:29:48.471 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction test 2026-03-09T15:29:48.472 INFO:teuthology.orchestra.run.vm04.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 6.6 MB/s | 837 kB 00:00 2026-03-09T15:29:48.472 INFO:teuthology.orchestra.run.vm04.stdout:-------------------------------------------------------------------------------- 2026-03-09T15:29:48.472 INFO:teuthology.orchestra.run.vm04.stdout:Total 2.6 MB/s | 2.3 MB 00:00 2026-03-09T15:29:48.528 INFO:teuthology.orchestra.run.vm03.stdout:Transaction test succeeded. 2026-03-09T15:29:48.528 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction 2026-03-09T15:29:48.531 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction check 2026-03-09T15:29:48.539 INFO:teuthology.orchestra.run.vm04.stdout:Transaction check succeeded. 2026-03-09T15:29:48.539 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction test 2026-03-09T15:29:48.600 INFO:teuthology.orchestra.run.vm04.stdout:Transaction test succeeded. 2026-03-09T15:29:48.601 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction 2026-03-09T15:29:48.702 INFO:teuthology.orchestra.run.vm03.stdout: Preparing : 1/1 2026-03-09T15:29:48.715 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2026-03-09T15:29:48.727 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 2/6 2026-03-09T15:29:48.735 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-03-09T15:29:48.745 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/6 2026-03-09T15:29:48.749 INFO:teuthology.orchestra.run.vm03.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/6 2026-03-09T15:29:48.785 INFO:teuthology.orchestra.run.vm04.stdout: Preparing : 1/1 2026-03-09T15:29:48.799 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2026-03-09T15:29:48.814 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 2/6 2026-03-09T15:29:48.821 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-03-09T15:29:48.830 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/6 2026-03-09T15:29:48.831 INFO:teuthology.orchestra.run.vm04.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/6 2026-03-09T15:29:48.939 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/6 2026-03-09T15:29:48.946 INFO:teuthology.orchestra.run.vm03.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 6/6 2026-03-09T15:29:48.986 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/6 2026-03-09T15:29:48.995 INFO:teuthology.orchestra.run.vm04.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 6/6 2026-03-09T15:29:49.374 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 6/6 2026-03-09T15:29:49.374 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-03-09T15:29:49.375 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:29:49.407 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 6/6 2026-03-09T15:29:49.407 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-03-09T15:29:49.408 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:29:49.985 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/6 2026-03-09T15:29:49.985 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/6 2026-03-09T15:29:49.985 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/6 2026-03-09T15:29:49.985 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-03-09T15:29:49.985 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/6 2026-03-09T15:29:49.985 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/6 2026-03-09T15:29:49.986 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/6 2026-03-09T15:29:49.986 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-03-09T15:29:49.986 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/6 2026-03-09T15:29:49.986 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/6 2026-03-09T15:29:50.089 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2026-03-09T15:29:50.089 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:29:50.089 INFO:teuthology.orchestra.run.vm03.stdout:Installed: 2026-03-09T15:29:50.089 INFO:teuthology.orchestra.run.vm03.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-03-09T15:29:50.089 INFO:teuthology.orchestra.run.vm03.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-03-09T15:29:50.089 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-03-09T15:29:50.089 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:29:50.089 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:29:50.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2026-03-09T15:29:50.114 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:29:50.114 INFO:teuthology.orchestra.run.vm04.stdout:Installed: 2026-03-09T15:29:50.114 INFO:teuthology.orchestra.run.vm04.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-03-09T15:29:50.114 INFO:teuthology.orchestra.run.vm04.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-03-09T15:29:50.114 INFO:teuthology.orchestra.run.vm04.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-03-09T15:29:50.114 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:29:50.114 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:29:50.162 DEBUG:teuthology.parallel:result is None 2026-03-09T15:29:50.178 DEBUG:teuthology.parallel:result is None 2026-03-09T15:29:50.178 INFO:teuthology.run_tasks:Running task install... 2026-03-09T15:29:50.180 DEBUG:teuthology.task.install:project ceph 2026-03-09T15:29:50.180 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df'}, 'extra_system_packages': {'deb': ['python3-xmltodict', 'python3-jmespath'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 'python3-jmespath']}} 2026-03-09T15:29:50.180 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df', 'extra_system_packages': {'deb': ['python3-xmltodict', 'python3-jmespath'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 'python3-jmespath']}} 2026-03-09T15:29:50.180 INFO:teuthology.task.install:Using flavor: default 2026-03-09T15:29:50.182 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-03-09T15:29:50.182 INFO:teuthology.task.install:extra packages: [] 2026-03-09T15:29:50.182 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['python3-xmltodict', 'python3-jmespath'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 'python3-jmespath']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df', 'tag': None, 'wait_for_package': False} 2026-03-09T15:29:50.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T15:29:50.183 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['python3-xmltodict', 'python3-jmespath'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 'python3-jmespath']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df', 'tag': None, 'wait_for_package': False} 2026-03-09T15:29:50.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T15:29:50.815 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/ 2026-03-09T15:29:50.815 INFO:teuthology.task.install.rpm:Package version is 19.2.3-678.ge911bdeb 2026-03-09T15:29:50.877 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/ 2026-03-09T15:29:50.877 INFO:teuthology.task.install.rpm:Package version is 19.2.3-678.ge911bdeb 2026-03-09T15:29:51.357 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-03-09T15:29:51.357 DEBUG:teuthology.orchestra.run.vm04:> set -ex 2026-03-09T15:29:51.357 DEBUG:teuthology.orchestra.run.vm04:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-03-09T15:29:51.371 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-03-09T15:29:51.371 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T15:29:51.371 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-03-09T15:29:51.391 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bzip2, perl-Test-Harness, python3-xmltodict, python3-jmespath on remote rpm x86_64 2026-03-09T15:29:51.391 DEBUG:teuthology.orchestra.run.vm04:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e911bdebe5c8faa3800735d1568fcdca65db60df/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-03-09T15:29:51.409 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bzip2, perl-Test-Harness, python3-xmltodict, python3-jmespath on remote rpm x86_64 2026-03-09T15:29:51.409 DEBUG:teuthology.orchestra.run.vm03:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e911bdebe5c8faa3800735d1568fcdca65db60df/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-03-09T15:29:51.462 DEBUG:teuthology.orchestra.run.vm04:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-03-09T15:29:51.485 DEBUG:teuthology.orchestra.run.vm03:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-03-09T15:29:51.553 DEBUG:teuthology.orchestra.run.vm04:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-03-09T15:29:51.571 DEBUG:teuthology.orchestra.run.vm03:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-03-09T15:29:51.584 INFO:teuthology.orchestra.run.vm04.stdout:check_obsoletes = 1 2026-03-09T15:29:51.585 DEBUG:teuthology.orchestra.run.vm04:> sudo yum clean all 2026-03-09T15:29:51.597 INFO:teuthology.orchestra.run.vm03.stdout:check_obsoletes = 1 2026-03-09T15:29:51.598 DEBUG:teuthology.orchestra.run.vm03:> sudo yum clean all 2026-03-09T15:29:51.795 INFO:teuthology.orchestra.run.vm04.stdout:41 files removed 2026-03-09T15:29:51.820 INFO:teuthology.orchestra.run.vm03.stdout:41 files removed 2026-03-09T15:29:51.828 DEBUG:teuthology.orchestra.run.vm04:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bzip2 perl-Test-Harness python3-xmltodict python3-jmespath 2026-03-09T15:29:51.855 DEBUG:teuthology.orchestra.run.vm03:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bzip2 perl-Test-Harness python3-xmltodict python3-jmespath 2026-03-09T15:29:53.212 INFO:teuthology.orchestra.run.vm04.stdout:ceph packages for x86_64 71 kB/s | 84 kB 00:01 2026-03-09T15:29:53.213 INFO:teuthology.orchestra.run.vm03.stdout:ceph packages for x86_64 70 kB/s | 84 kB 00:01 2026-03-09T15:29:54.171 INFO:teuthology.orchestra.run.vm04.stdout:ceph noarch packages 12 kB/s | 12 kB 00:00 2026-03-09T15:29:54.189 INFO:teuthology.orchestra.run.vm03.stdout:ceph noarch packages 12 kB/s | 12 kB 00:00 2026-03-09T15:29:55.148 INFO:teuthology.orchestra.run.vm04.stdout:ceph source packages 2.0 kB/s | 1.9 kB 00:00 2026-03-09T15:29:55.179 INFO:teuthology.orchestra.run.vm03.stdout:ceph source packages 2.0 kB/s | 1.9 kB 00:00 2026-03-09T15:29:55.434 INFO:teuthology.orchestra.run.vm03.stdout:CentOS Stream 9 - BaseOS 37 MB/s | 8.9 MB 00:00 2026-03-09T15:29:56.373 INFO:teuthology.orchestra.run.vm04.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.9 MB 00:01 2026-03-09T15:29:58.689 INFO:teuthology.orchestra.run.vm04.stdout:CentOS Stream 9 - AppStream 18 MB/s | 27 MB 00:01 2026-03-09T15:29:58.788 INFO:teuthology.orchestra.run.vm03.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-03-09T15:30:03.267 INFO:teuthology.orchestra.run.vm04.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 8.0 MB 00:01 2026-03-09T15:30:03.812 INFO:teuthology.orchestra.run.vm03.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 8.0 MB 00:01 2026-03-09T15:30:05.080 INFO:teuthology.orchestra.run.vm04.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 20 kB 00:00 2026-03-09T15:30:05.580 INFO:teuthology.orchestra.run.vm04.stdout:Extra Packages for Enterprise Linux 48 MB/s | 20 MB 00:00 2026-03-09T15:30:06.676 INFO:teuthology.orchestra.run.vm03.stdout:CentOS Stream 9 - Extras packages 10 kB/s | 20 kB 00:02 2026-03-09T15:30:07.125 INFO:teuthology.orchestra.run.vm03.stdout:Extra Packages for Enterprise Linux 56 MB/s | 20 MB 00:00 2026-03-09T15:30:10.034 INFO:teuthology.orchestra.run.vm04.stdout:lab-extras 65 kB/s | 50 kB 00:00 2026-03-09T15:30:11.421 INFO:teuthology.orchestra.run.vm04.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-03-09T15:30:11.422 INFO:teuthology.orchestra.run.vm04.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-03-09T15:30:11.426 INFO:teuthology.orchestra.run.vm04.stdout:Package bzip2-1.0.8-11.el9.x86_64 is already installed. 2026-03-09T15:30:11.426 INFO:teuthology.orchestra.run.vm04.stdout:Package perl-Test-Harness-1:3.42-461.el9.noarch is already installed. 2026-03-09T15:30:11.454 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout:====================================================================================== 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: Package Arch Version Repository Size 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout:====================================================================================== 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout:Installing: 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 6.5 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-base x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 5.5 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-fuse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.2 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 145 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.1 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-cephadm noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 150 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-dashboard noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 3.8 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 7.4 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-rook noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 49 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-radosgw x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 11 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-test x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 50 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-volume noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 299 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: cephadm noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 769 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: libcephfs-devel x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 34 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: libcephfs2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.0 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: librados-devel x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 127 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: python3-cephfs x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 165 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: python3-rados x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 323 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: python3-rbd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 303 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: python3-rgw x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 100 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: rbd-fuse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 85 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: rbd-mirror x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.1 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: rbd-nbd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 171 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout:Upgrading: 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: librados2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.4 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: librbd1 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.2 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout:Installing dependencies: 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-common x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 22 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-grafana-dashboards noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 31 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mds x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 2.4 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-modules-core noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 253 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mon x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 4.7 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-osd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 17 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-prometheus-alerts noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 17 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ceph-selinux x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 25 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: libcephsqlite x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 163 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-03-09T15:30:11.458 INFO:teuthology.orchestra.run.vm04.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: libradosstriper1 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 503 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: librgw2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 5.4 M 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-ceph-argparse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 45 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-ceph-common x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 142 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-03-09T15:30:11.459 INFO:teuthology.orchestra.run.vm04.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout:Installing weak dependencies: 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout:Transaction Summary 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout:====================================================================================== 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout:Install 134 Packages 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout:Upgrade 2 Packages 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout:Total download size: 210 M 2026-03-09T15:30:11.460 INFO:teuthology.orchestra.run.vm04.stdout:Downloading Packages: 2026-03-09T15:30:11.807 INFO:teuthology.orchestra.run.vm03.stdout:lab-extras 64 kB/s | 50 kB 00:00 2026-03-09T15:30:13.180 INFO:teuthology.orchestra.run.vm03.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-03-09T15:30:13.180 INFO:teuthology.orchestra.run.vm03.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-03-09T15:30:13.185 INFO:teuthology.orchestra.run.vm03.stdout:Package bzip2-1.0.8-11.el9.x86_64 is already installed. 2026-03-09T15:30:13.185 INFO:teuthology.orchestra.run.vm03.stdout:Package perl-Test-Harness-1:3.42-461.el9.noarch is already installed. 2026-03-09T15:30:13.217 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout:====================================================================================== 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout: Package Arch Version Repository Size 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout:====================================================================================== 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout:Installing: 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout: ceph x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 6.5 k 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout: ceph-base x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 5.5 M 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout: ceph-fuse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.2 M 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 145 k 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.1 M 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-cephadm noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 150 k 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-dashboard noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 3.8 M 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 7.4 M 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-rook noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 49 k 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout: ceph-radosgw x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 11 M 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout: ceph-test x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 50 M 2026-03-09T15:30:13.221 INFO:teuthology.orchestra.run.vm03.stdout: ceph-volume noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 299 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: cephadm noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 769 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: libcephfs-devel x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 34 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: libcephfs2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.0 M 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: librados-devel x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 127 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: python3-cephfs x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 165 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: python3-rados x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 323 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: python3-rbd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 303 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: python3-rgw x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 100 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: rbd-fuse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 85 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: rbd-mirror x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.1 M 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: rbd-nbd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 171 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout:Upgrading: 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: librados2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.4 M 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: librbd1 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.2 M 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout:Installing dependencies: 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: ceph-common x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 22 M 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: ceph-grafana-dashboards noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 31 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mds x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 2.4 M 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-modules-core noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 253 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mon x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 4.7 M 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: ceph-osd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 17 M 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: ceph-prometheus-alerts noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 17 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: ceph-selinux x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 25 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: libcephsqlite x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 163 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: libradosstriper1 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 503 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: librgw2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 5.4 M 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-03-09T15:30:13.222 INFO:teuthology.orchestra.run.vm03.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-ceph-argparse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 45 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-ceph-common x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 142 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-03-09T15:30:13.223 INFO:teuthology.orchestra.run.vm03.stdout:Installing weak dependencies: 2026-03-09T15:30:13.224 INFO:teuthology.orchestra.run.vm03.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-03-09T15:30:13.224 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:13.224 INFO:teuthology.orchestra.run.vm03.stdout:Transaction Summary 2026-03-09T15:30:13.224 INFO:teuthology.orchestra.run.vm03.stdout:====================================================================================== 2026-03-09T15:30:13.224 INFO:teuthology.orchestra.run.vm03.stdout:Install 134 Packages 2026-03-09T15:30:13.224 INFO:teuthology.orchestra.run.vm03.stdout:Upgrade 2 Packages 2026-03-09T15:30:13.224 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:13.224 INFO:teuthology.orchestra.run.vm03.stdout:Total download size: 210 M 2026-03-09T15:30:13.224 INFO:teuthology.orchestra.run.vm03.stdout:Downloading Packages: 2026-03-09T15:30:13.943 INFO:teuthology.orchestra.run.vm04.stdout:(1/136): ceph-19.2.3-678.ge911bdeb.el9.x86_64.r 13 kB/s | 6.5 kB 00:00 2026-03-09T15:30:14.221 INFO:teuthology.orchestra.run.vm03.stdout:(1/136): ceph-19.2.3-678.ge911bdeb.el9.x86_64.r 12 kB/s | 6.5 kB 00:00 2026-03-09T15:30:14.855 INFO:teuthology.orchestra.run.vm04.stdout:(2/136): ceph-fuse-19.2.3-678.ge911bdeb.el9.x86 1.3 MB/s | 1.2 MB 00:00 2026-03-09T15:30:14.972 INFO:teuthology.orchestra.run.vm04.stdout:(3/136): ceph-immutable-object-cache-19.2.3-678 1.2 MB/s | 145 kB 00:00 2026-03-09T15:30:15.217 INFO:teuthology.orchestra.run.vm03.stdout:(2/136): ceph-fuse-19.2.3-678.ge911bdeb.el9.x86 1.2 MB/s | 1.2 MB 00:00 2026-03-09T15:30:15.343 INFO:teuthology.orchestra.run.vm03.stdout:(3/136): ceph-immutable-object-cache-19.2.3-678 1.1 MB/s | 145 kB 00:00 2026-03-09T15:30:15.660 INFO:teuthology.orchestra.run.vm04.stdout:(4/136): ceph-mds-19.2.3-678.ge911bdeb.el9.x86_ 3.5 MB/s | 2.4 MB 00:00 2026-03-09T15:30:15.723 INFO:teuthology.orchestra.run.vm04.stdout:(5/136): ceph-base-19.2.3-678.ge911bdeb.el9.x86 2.4 MB/s | 5.5 MB 00:02 2026-03-09T15:30:15.990 INFO:teuthology.orchestra.run.vm03.stdout:(4/136): ceph-base-19.2.3-678.ge911bdeb.el9.x86 2.4 MB/s | 5.5 MB 00:02 2026-03-09T15:30:16.003 INFO:teuthology.orchestra.run.vm04.stdout:(6/136): ceph-mgr-19.2.3-678.ge911bdeb.el9.x86_ 3.1 MB/s | 1.1 MB 00:00 2026-03-09T15:30:16.098 INFO:teuthology.orchestra.run.vm03.stdout:(5/136): ceph-mds-19.2.3-678.ge911bdeb.el9.x86_ 3.2 MB/s | 2.4 MB 00:00 2026-03-09T15:30:16.340 INFO:teuthology.orchestra.run.vm03.stdout:(6/136): ceph-mgr-19.2.3-678.ge911bdeb.el9.x86_ 3.1 MB/s | 1.1 MB 00:00 2026-03-09T15:30:16.517 INFO:teuthology.orchestra.run.vm04.stdout:(7/136): ceph-mon-19.2.3-678.ge911bdeb.el9.x86_ 6.0 MB/s | 4.7 MB 00:00 2026-03-09T15:30:17.116 INFO:teuthology.orchestra.run.vm03.stdout:(7/136): ceph-mon-19.2.3-678.ge911bdeb.el9.x86_ 4.7 MB/s | 4.7 MB 00:01 2026-03-09T15:30:17.738 INFO:teuthology.orchestra.run.vm04.stdout:(8/136): ceph-common-19.2.3-678.ge911bdeb.el9.x 5.1 MB/s | 22 MB 00:04 2026-03-09T15:30:17.779 INFO:teuthology.orchestra.run.vm04.stdout:(9/136): ceph-radosgw-19.2.3-678.ge911bdeb.el9. 8.5 MB/s | 11 MB 00:01 2026-03-09T15:30:17.852 INFO:teuthology.orchestra.run.vm04.stdout:(10/136): ceph-selinux-19.2.3-678.ge911bdeb.el9 221 kB/s | 25 kB 00:00 2026-03-09T15:30:17.967 INFO:teuthology.orchestra.run.vm04.stdout:(11/136): libcephfs-devel-19.2.3-678.ge911bdeb. 293 kB/s | 34 kB 00:00 2026-03-09T15:30:18.095 INFO:teuthology.orchestra.run.vm04.stdout:(12/136): libcephfs2-19.2.3-678.ge911bdeb.el9.x 7.7 MB/s | 1.0 MB 00:00 2026-03-09T15:30:18.212 INFO:teuthology.orchestra.run.vm04.stdout:(13/136): libcephsqlite-19.2.3-678.ge911bdeb.el 1.4 MB/s | 163 kB 00:00 2026-03-09T15:30:18.262 INFO:teuthology.orchestra.run.vm04.stdout:(14/136): ceph-osd-19.2.3-678.ge911bdeb.el9.x86 7.6 MB/s | 17 MB 00:02 2026-03-09T15:30:18.327 INFO:teuthology.orchestra.run.vm04.stdout:(15/136): librados-devel-19.2.3-678.ge911bdeb.e 1.1 MB/s | 127 kB 00:00 2026-03-09T15:30:18.380 INFO:teuthology.orchestra.run.vm04.stdout:(16/136): libradosstriper1-19.2.3-678.ge911bdeb 4.1 MB/s | 503 kB 00:00 2026-03-09T15:30:18.498 INFO:teuthology.orchestra.run.vm04.stdout:(17/136): python3-ceph-argparse-19.2.3-678.ge91 383 kB/s | 45 kB 00:00 2026-03-09T15:30:18.614 INFO:teuthology.orchestra.run.vm04.stdout:(18/136): python3-ceph-common-19.2.3-678.ge911b 1.2 MB/s | 142 kB 00:00 2026-03-09T15:30:18.640 INFO:teuthology.orchestra.run.vm03.stdout:(8/136): ceph-radosgw-19.2.3-678.ge911bdeb.el9. 7.1 MB/s | 11 MB 00:01 2026-03-09T15:30:18.730 INFO:teuthology.orchestra.run.vm04.stdout:(19/136): python3-cephfs-19.2.3-678.ge911bdeb.e 1.4 MB/s | 165 kB 00:00 2026-03-09T15:30:18.765 INFO:teuthology.orchestra.run.vm03.stdout:(9/136): ceph-selinux-19.2.3-678.ge911bdeb.el9. 199 kB/s | 25 kB 00:00 2026-03-09T15:30:18.847 INFO:teuthology.orchestra.run.vm04.stdout:(20/136): python3-rados-19.2.3-678.ge911bdeb.el 2.7 MB/s | 323 kB 00:00 2026-03-09T15:30:18.930 INFO:teuthology.orchestra.run.vm04.stdout:(21/136): librgw2-19.2.3-678.ge911bdeb.el9.x86_ 9.0 MB/s | 5.4 MB 00:00 2026-03-09T15:30:18.964 INFO:teuthology.orchestra.run.vm04.stdout:(22/136): python3-rbd-19.2.3-678.ge911bdeb.el9. 2.5 MB/s | 303 kB 00:00 2026-03-09T15:30:19.046 INFO:teuthology.orchestra.run.vm04.stdout:(23/136): python3-rgw-19.2.3-678.ge911bdeb.el9. 855 kB/s | 100 kB 00:00 2026-03-09T15:30:19.079 INFO:teuthology.orchestra.run.vm04.stdout:(24/136): rbd-fuse-19.2.3-678.ge911bdeb.el9.x86 741 kB/s | 85 kB 00:00 2026-03-09T15:30:19.200 INFO:teuthology.orchestra.run.vm04.stdout:(25/136): rbd-nbd-19.2.3-678.ge911bdeb.el9.x86_ 1.4 MB/s | 171 kB 00:00 2026-03-09T15:30:19.318 INFO:teuthology.orchestra.run.vm04.stdout:(26/136): ceph-grafana-dashboards-19.2.3-678.ge 265 kB/s | 31 kB 00:00 2026-03-09T15:30:19.381 INFO:teuthology.orchestra.run.vm03.stdout:(10/136): ceph-common-19.2.3-678.ge911bdeb.el9. 3.8 MB/s | 22 MB 00:05 2026-03-09T15:30:19.434 INFO:teuthology.orchestra.run.vm04.stdout:(27/136): ceph-mgr-cephadm-19.2.3-678.ge911bdeb 1.3 MB/s | 150 kB 00:00 2026-03-09T15:30:19.497 INFO:teuthology.orchestra.run.vm03.stdout:(11/136): libcephfs-devel-19.2.3-678.ge911bdeb. 292 kB/s | 34 kB 00:00 2026-03-09T15:30:19.543 INFO:teuthology.orchestra.run.vm04.stdout:(28/136): rbd-mirror-19.2.3-678.ge911bdeb.el9.x 6.3 MB/s | 3.1 MB 00:00 2026-03-09T15:30:19.731 INFO:teuthology.orchestra.run.vm03.stdout:(12/136): libcephfs2-19.2.3-678.ge911bdeb.el9.x 4.2 MB/s | 1.0 MB 00:00 2026-03-09T15:30:19.848 INFO:teuthology.orchestra.run.vm03.stdout:(13/136): libcephsqlite-19.2.3-678.ge911bdeb.el 1.4 MB/s | 163 kB 00:00 2026-03-09T15:30:19.913 INFO:teuthology.orchestra.run.vm04.stdout:(29/136): ceph-mgr-dashboard-19.2.3-678.ge911bd 7.9 MB/s | 3.8 MB 00:00 2026-03-09T15:30:19.969 INFO:teuthology.orchestra.run.vm03.stdout:(14/136): librados-devel-19.2.3-678.ge911bdeb.e 1.0 MB/s | 127 kB 00:00 2026-03-09T15:30:20.031 INFO:teuthology.orchestra.run.vm04.stdout:(30/136): ceph-mgr-modules-core-19.2.3-678.ge91 2.1 MB/s | 253 kB 00:00 2026-03-09T15:30:20.091 INFO:teuthology.orchestra.run.vm03.stdout:(15/136): libradosstriper1-19.2.3-678.ge911bdeb 4.0 MB/s | 503 kB 00:00 2026-03-09T15:30:20.146 INFO:teuthology.orchestra.run.vm04.stdout:(31/136): ceph-mgr-rook-19.2.3-678.ge911bdeb.el 429 kB/s | 49 kB 00:00 2026-03-09T15:30:20.265 INFO:teuthology.orchestra.run.vm04.stdout:(32/136): ceph-prometheus-alerts-19.2.3-678.ge9 142 kB/s | 17 kB 00:00 2026-03-09T15:30:20.383 INFO:teuthology.orchestra.run.vm04.stdout:(33/136): ceph-volume-19.2.3-678.ge911bdeb.el9. 2.5 MB/s | 299 kB 00:00 2026-03-09T15:30:20.506 INFO:teuthology.orchestra.run.vm04.stdout:(34/136): cephadm-19.2.3-678.ge911bdeb.el9.noar 6.1 MB/s | 769 kB 00:00 2026-03-09T15:30:20.770 INFO:teuthology.orchestra.run.vm04.stdout:(35/136): cryptsetup-2.8.1-3.el9.x86_64.rpm 1.3 MB/s | 351 kB 00:00 2026-03-09T15:30:20.869 INFO:teuthology.orchestra.run.vm04.stdout:(36/136): ledmon-libs-1.1.0-3.el9.x86_64.rpm 411 kB/s | 40 kB 00:00 2026-03-09T15:30:20.973 INFO:teuthology.orchestra.run.vm03.stdout:(16/136): ceph-osd-19.2.3-678.ge911bdeb.el9.x86 3.7 MB/s | 17 MB 00:04 2026-03-09T15:30:21.002 INFO:teuthology.orchestra.run.vm04.stdout:(37/136): libconfig-1.7.2-9.el9.x86_64.rpm 543 kB/s | 72 kB 00:00 2026-03-09T15:30:21.092 INFO:teuthology.orchestra.run.vm03.stdout:(17/136): python3-ceph-argparse-19.2.3-678.ge91 381 kB/s | 45 kB 00:00 2026-03-09T15:30:21.136 INFO:teuthology.orchestra.run.vm03.stdout:(18/136): librgw2-19.2.3-678.ge911bdeb.el9.x86_ 5.2 MB/s | 5.4 MB 00:01 2026-03-09T15:30:21.149 INFO:teuthology.orchestra.run.vm04.stdout:(38/136): libgfortran-11.5.0-14.el9.x86_64.rpm 5.3 MB/s | 794 kB 00:00 2026-03-09T15:30:21.208 INFO:teuthology.orchestra.run.vm03.stdout:(19/136): python3-ceph-common-19.2.3-678.ge911b 1.2 MB/s | 142 kB 00:00 2026-03-09T15:30:21.218 INFO:teuthology.orchestra.run.vm04.stdout:(39/136): libquadmath-11.5.0-14.el9.x86_64.rpm 2.6 MB/s | 184 kB 00:00 2026-03-09T15:30:21.252 INFO:teuthology.orchestra.run.vm04.stdout:(40/136): mailcap-2.1.49-5.el9.noarch.rpm 989 kB/s | 33 kB 00:00 2026-03-09T15:30:21.253 INFO:teuthology.orchestra.run.vm03.stdout:(20/136): python3-cephfs-19.2.3-678.ge911bdeb.e 1.4 MB/s | 165 kB 00:00 2026-03-09T15:30:21.326 INFO:teuthology.orchestra.run.vm03.stdout:(21/136): python3-rados-19.2.3-678.ge911bdeb.el 2.7 MB/s | 323 kB 00:00 2026-03-09T15:30:21.425 INFO:teuthology.orchestra.run.vm03.stdout:(22/136): python3-rbd-19.2.3-678.ge911bdeb.el9. 1.7 MB/s | 303 kB 00:00 2026-03-09T15:30:21.425 INFO:teuthology.orchestra.run.vm04.stdout:(41/136): ceph-test-19.2.3-678.ge911bdeb.el9.x8 14 MB/s | 50 MB 00:03 2026-03-09T15:30:21.427 INFO:teuthology.orchestra.run.vm04.stdout:(42/136): pciutils-3.7.0-7.el9.x86_64.rpm 533 kB/s | 93 kB 00:00 2026-03-09T15:30:21.442 INFO:teuthology.orchestra.run.vm03.stdout:(23/136): python3-rgw-19.2.3-678.ge911bdeb.el9. 858 kB/s | 100 kB 00:00 2026-03-09T15:30:21.534 INFO:teuthology.orchestra.run.vm04.stdout:(43/136): python3-cryptography-36.0.1-5.el9.x86 12 MB/s | 1.2 MB 00:00 2026-03-09T15:30:21.541 INFO:teuthology.orchestra.run.vm03.stdout:(24/136): rbd-fuse-19.2.3-678.ge911bdeb.el9.x86 737 kB/s | 85 kB 00:00 2026-03-09T15:30:21.578 INFO:teuthology.orchestra.run.vm04.stdout:(44/136): python3-ply-3.11-14.el9.noarch.rpm 2.4 MB/s | 106 kB 00:00 2026-03-09T15:30:21.633 INFO:teuthology.orchestra.run.vm04.stdout:(45/136): ceph-mgr-diskprediction-local-19.2.3- 3.5 MB/s | 7.4 MB 00:02 2026-03-09T15:30:21.644 INFO:teuthology.orchestra.run.vm04.stdout:(46/136): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2026-03-09T15:30:21.657 INFO:teuthology.orchestra.run.vm03.stdout:(25/136): rbd-nbd-19.2.3-678.ge911bdeb.el9.x86_ 1.4 MB/s | 171 kB 00:00 2026-03-09T15:30:21.669 INFO:teuthology.orchestra.run.vm04.stdout:(47/136): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2026-03-09T15:30:21.746 INFO:teuthology.orchestra.run.vm04.stdout:(48/136): python3-urllib3-1.26.5-7.el9.noarch.r 2.1 MB/s | 218 kB 00:00 2026-03-09T15:30:21.759 INFO:teuthology.orchestra.run.vm04.stdout:(49/136): unzip-6.0-59.el9.x86_64.rpm 2.0 MB/s | 182 kB 00:00 2026-03-09T15:30:21.773 INFO:teuthology.orchestra.run.vm03.stdout:(26/136): ceph-grafana-dashboards-19.2.3-678.ge 270 kB/s | 31 kB 00:00 2026-03-09T15:30:21.845 INFO:teuthology.orchestra.run.vm04.stdout:(50/136): zip-3.0-35.el9.x86_64.rpm 2.6 MB/s | 266 kB 00:00 2026-03-09T15:30:21.863 INFO:teuthology.orchestra.run.vm04.stdout:(51/136): python3-requests-2.25.1-10.el9.noarch 552 kB/s | 126 kB 00:00 2026-03-09T15:30:21.889 INFO:teuthology.orchestra.run.vm03.stdout:(27/136): ceph-mgr-cephadm-19.2.3-678.ge911bdeb 1.3 MB/s | 150 kB 00:00 2026-03-09T15:30:21.938 INFO:teuthology.orchestra.run.vm04.stdout:(52/136): boost-program-options-1.75.0-13.el9.x 581 kB/s | 104 kB 00:00 2026-03-09T15:30:21.947 INFO:teuthology.orchestra.run.vm04.stdout:(53/136): flexiblas-3.0.4-9.el9.x86_64.rpm 289 kB/s | 30 kB 00:00 2026-03-09T15:30:21.987 INFO:teuthology.orchestra.run.vm04.stdout:(54/136): flexiblas-openblas-openmp-3.0.4-9.el9 308 kB/s | 15 kB 00:00 2026-03-09T15:30:22.089 INFO:teuthology.orchestra.run.vm04.stdout:(55/136): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.5 MB/s | 160 kB 00:00 2026-03-09T15:30:22.115 INFO:teuthology.orchestra.run.vm04.stdout:(56/136): libnbd-1.20.3-4.el9.x86_64.rpm 977 kB/s | 164 kB 00:00 2026-03-09T15:30:22.132 INFO:teuthology.orchestra.run.vm04.stdout:(57/136): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2026-03-09T15:30:22.246 INFO:teuthology.orchestra.run.vm04.stdout:(58/136): libstoragemgmt-1.10.1-1.el9.x86_64.rp 2.1 MB/s | 246 kB 00:00 2026-03-09T15:30:22.339 INFO:teuthology.orchestra.run.vm04.stdout:(59/136): librdkafka-1.6.1-102.el9.x86_64.rpm 2.9 MB/s | 662 kB 00:00 2026-03-09T15:30:22.344 INFO:teuthology.orchestra.run.vm04.stdout:(60/136): libxslt-1.1.34-12.el9.x86_64.rpm 2.3 MB/s | 233 kB 00:00 2026-03-09T15:30:22.387 INFO:teuthology.orchestra.run.vm04.stdout:(61/136): flexiblas-netlib-3.0.4-9.el9.x86_64.r 5.7 MB/s | 3.0 MB 00:00 2026-03-09T15:30:22.417 INFO:teuthology.orchestra.run.vm04.stdout:(62/136): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 292 kB 00:00 2026-03-09T15:30:22.432 INFO:teuthology.orchestra.run.vm04.stdout:(63/136): lua-5.4.4-4.el9.x86_64.rpm 2.1 MB/s | 188 kB 00:00 2026-03-09T15:30:22.434 INFO:teuthology.orchestra.run.vm04.stdout:(64/136): openblas-0.3.29-1.el9.x86_64.rpm 888 kB/s | 42 kB 00:00 2026-03-09T15:30:22.593 INFO:teuthology.orchestra.run.vm03.stdout:(28/136): ceph-mgr-dashboard-19.2.3-678.ge911bd 5.4 MB/s | 3.8 MB 00:00 2026-03-09T15:30:22.601 INFO:teuthology.orchestra.run.vm03.stdout:(29/136): rbd-mirror-19.2.3-678.ge911bdeb.el9.x 2.7 MB/s | 3.1 MB 00:01 2026-03-09T15:30:22.612 INFO:teuthology.orchestra.run.vm04.stdout:(65/136): protobuf-3.14.0-17.el9.x86_64.rpm 5.6 MB/s | 1.0 MB 00:00 2026-03-09T15:30:22.679 INFO:teuthology.orchestra.run.vm04.stdout:(66/136): python3-devel-3.9.25-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2026-03-09T15:30:22.719 INFO:teuthology.orchestra.run.vm04.stdout:(67/136): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2026-03-09T15:30:22.719 INFO:teuthology.orchestra.run.vm03.stdout:(30/136): ceph-mgr-modules-core-19.2.3-678.ge91 2.1 MB/s | 253 kB 00:00 2026-03-09T15:30:22.758 INFO:teuthology.orchestra.run.vm04.stdout:(68/136): python3-jinja2-2.11.3-8.el9.noarch.rp 3.1 MB/s | 249 kB 00:00 2026-03-09T15:30:22.770 INFO:teuthology.orchestra.run.vm04.stdout:(69/136): python3-jmespath-1.0.1-1.el9.noarch.r 940 kB/s | 48 kB 00:00 2026-03-09T15:30:22.806 INFO:teuthology.orchestra.run.vm04.stdout:(70/136): openblas-openmp-0.3.29-1.el9.x86_64.r 14 MB/s | 5.3 MB 00:00 2026-03-09T15:30:22.835 INFO:teuthology.orchestra.run.vm03.stdout:(31/136): ceph-mgr-rook-19.2.3-678.ge911bdeb.el 427 kB/s | 49 kB 00:00 2026-03-09T15:30:22.839 INFO:teuthology.orchestra.run.vm04.stdout:(71/136): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 172 kB 00:00 2026-03-09T15:30:22.856 INFO:teuthology.orchestra.run.vm04.stdout:(72/136): python3-libstoragemgmt-1.10.1-1.el9.x 1.8 MB/s | 177 kB 00:00 2026-03-09T15:30:22.857 INFO:teuthology.orchestra.run.vm04.stdout:(73/136): python3-markupsafe-1.1.1-12.el9.x86_6 684 kB/s | 35 kB 00:00 2026-03-09T15:30:22.950 INFO:teuthology.orchestra.run.vm04.stdout:(74/136): python3-packaging-20.9-5.el9.noarch.r 838 kB/s | 77 kB 00:00 2026-03-09T15:30:22.951 INFO:teuthology.orchestra.run.vm03.stdout:(32/136): ceph-prometheus-alerts-19.2.3-678.ge9 145 kB/s | 17 kB 00:00 2026-03-09T15:30:22.964 INFO:teuthology.orchestra.run.vm04.stdout:(75/136): python3-numpy-f2py-1.23.5-2.el9.x86_6 4.0 MB/s | 442 kB 00:00 2026-03-09T15:30:23.039 INFO:teuthology.orchestra.run.vm04.stdout:(76/136): python3-protobuf-3.14.0-17.el9.noarch 2.9 MB/s | 267 kB 00:00 2026-03-09T15:30:23.039 INFO:teuthology.orchestra.run.vm04.stdout:(77/136): python3-pyasn1-0.4.8-7.el9.noarch.rpm 2.0 MB/s | 157 kB 00:00 2026-03-09T15:30:23.070 INFO:teuthology.orchestra.run.vm03.stdout:(33/136): ceph-volume-19.2.3-678.ge911bdeb.el9. 2.5 MB/s | 299 kB 00:00 2026-03-09T15:30:23.097 INFO:teuthology.orchestra.run.vm04.stdout:(78/136): python3-requests-oauthlib-1.3.0-12.el 934 kB/s | 54 kB 00:00 2026-03-09T15:30:23.109 INFO:teuthology.orchestra.run.vm04.stdout:(79/136): python3-pyasn1-modules-0.4.8-7.el9.no 3.9 MB/s | 277 kB 00:00 2026-03-09T15:30:23.156 INFO:teuthology.orchestra.run.vm04.stdout:(80/136): python3-toml-0.10.2-6.el9.noarch.rpm 876 kB/s | 42 kB 00:00 2026-03-09T15:30:23.237 INFO:teuthology.orchestra.run.vm04.stdout:(81/136): qatlib-25.08.0-2.el9.x86_64.rpm 2.9 MB/s | 240 kB 00:00 2026-03-09T15:30:23.302 INFO:teuthology.orchestra.run.vm04.stdout:(82/136): python3-numpy-1.23.5-2.el9.x86_64.rpm 13 MB/s | 6.1 MB 00:00 2026-03-09T15:30:23.302 INFO:teuthology.orchestra.run.vm04.stdout:(83/136): qatlib-service-25.08.0-2.el9.x86_64.r 565 kB/s | 37 kB 00:00 2026-03-09T15:30:23.368 INFO:teuthology.orchestra.run.vm04.stdout:(84/136): qatzip-libs-1.3.1-1.el9.x86_64.rpm 1.0 MB/s | 66 kB 00:00 2026-03-09T15:30:23.382 INFO:teuthology.orchestra.run.vm04.stdout:(85/136): socat-1.7.4.1-8.el9.x86_64.rpm 3.8 MB/s | 303 kB 00:00 2026-03-09T15:30:23.486 INFO:teuthology.orchestra.run.vm03.stdout:(34/136): cephadm-19.2.3-678.ge911bdeb.el9.noar 1.8 MB/s | 769 kB 00:00 2026-03-09T15:30:23.488 INFO:teuthology.orchestra.run.vm04.stdout:(86/136): xmlstarlet-1.6.1-20.el9.x86_64.rpm 530 kB/s | 64 kB 00:00 2026-03-09T15:30:23.592 INFO:teuthology.orchestra.run.vm04.stdout:(87/136): lua-devel-5.4.4-4.el9.x86_64.rpm 106 kB/s | 22 kB 00:00 2026-03-09T15:30:23.609 INFO:teuthology.orchestra.run.vm04.stdout:(88/136): abseil-cpp-20211102.0-4.el9.x86_64.rp 33 MB/s | 551 kB 00:00 2026-03-09T15:30:23.616 INFO:teuthology.orchestra.run.vm04.stdout:(89/136): gperftools-libs-2.9.1-3.el9.x86_64.rp 42 MB/s | 308 kB 00:00 2026-03-09T15:30:23.618 INFO:teuthology.orchestra.run.vm04.stdout:(90/136): grpc-data-1.46.7-10.el9.noarch.rpm 8.6 MB/s | 19 kB 00:00 2026-03-09T15:30:23.698 INFO:teuthology.orchestra.run.vm03.stdout:(35/136): cryptsetup-2.8.1-3.el9.x86_64.rpm 1.6 MB/s | 351 kB 00:00 2026-03-09T15:30:23.704 INFO:teuthology.orchestra.run.vm04.stdout:(91/136): libarrow-9.0.0-15.el9.x86_64.rpm 52 MB/s | 4.4 MB 00:00 2026-03-09T15:30:23.707 INFO:teuthology.orchestra.run.vm04.stdout:(92/136): libarrow-doc-9.0.0-15.el9.noarch.rpm 9.0 MB/s | 25 kB 00:00 2026-03-09T15:30:23.710 INFO:teuthology.orchestra.run.vm04.stdout:(93/136): liboath-2.6.12-1.el9.x86_64.rpm 17 MB/s | 49 kB 00:00 2026-03-09T15:30:23.719 INFO:teuthology.orchestra.run.vm04.stdout:(94/136): libunwind-1.6.2-1.el9.x86_64.rpm 8.3 MB/s | 67 kB 00:00 2026-03-09T15:30:23.730 INFO:teuthology.orchestra.run.vm04.stdout:(95/136): luarocks-3.9.2-5.el9.noarch.rpm 14 MB/s | 151 kB 00:00 2026-03-09T15:30:23.730 INFO:teuthology.orchestra.run.vm03.stdout:(36/136): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.2 MB/s | 40 kB 00:00 2026-03-09T15:30:23.745 INFO:teuthology.orchestra.run.vm04.stdout:(96/136): parquet-libs-9.0.0-15.el9.x86_64.rpm 55 MB/s | 838 kB 00:00 2026-03-09T15:30:23.758 INFO:teuthology.orchestra.run.vm04.stdout:(97/136): python3-asyncssh-2.13.2-5.el9.noarch. 45 MB/s | 548 kB 00:00 2026-03-09T15:30:23.761 INFO:teuthology.orchestra.run.vm04.stdout:(98/136): python3-autocommand-2.2.2-8.el9.noarc 8.8 MB/s | 29 kB 00:00 2026-03-09T15:30:23.764 INFO:teuthology.orchestra.run.vm04.stdout:(99/136): python3-backports-tarfile-1.2.0-1.el9 21 MB/s | 60 kB 00:00 2026-03-09T15:30:23.767 INFO:teuthology.orchestra.run.vm04.stdout:(100/136): python3-bcrypt-3.2.2-1.el9.x86_64.rp 17 MB/s | 43 kB 00:00 2026-03-09T15:30:23.770 INFO:teuthology.orchestra.run.vm04.stdout:(101/136): python3-cachetools-4.2.4-1.el9.noarc 13 MB/s | 32 kB 00:00 2026-03-09T15:30:23.772 INFO:teuthology.orchestra.run.vm04.stdout:(102/136): python3-certifi-2023.05.07-4.el9.noa 6.1 MB/s | 14 kB 00:00 2026-03-09T15:30:23.778 INFO:teuthology.orchestra.run.vm04.stdout:(103/136): python3-cheroot-10.0.1-4.el9.noarch. 31 MB/s | 173 kB 00:00 2026-03-09T15:30:23.778 INFO:teuthology.orchestra.run.vm03.stdout:(37/136): libconfig-1.7.2-9.el9.x86_64.rpm 1.5 MB/s | 72 kB 00:00 2026-03-09T15:30:23.785 INFO:teuthology.orchestra.run.vm04.stdout:(104/136): python3-cherrypy-18.6.1-2.el9.noarch 46 MB/s | 358 kB 00:00 2026-03-09T15:30:23.792 INFO:teuthology.orchestra.run.vm04.stdout:(105/136): python3-google-auth-2.45.0-1.el9.noa 40 MB/s | 254 kB 00:00 2026-03-09T15:30:23.825 INFO:teuthology.orchestra.run.vm04.stdout:(106/136): python3-grpcio-1.46.7-10.el9.x86_64. 63 MB/s | 2.0 MB 00:00 2026-03-09T15:30:23.829 INFO:teuthology.orchestra.run.vm04.stdout:(107/136): python3-grpcio-tools-1.46.7-10.el9.x 36 MB/s | 144 kB 00:00 2026-03-09T15:30:23.831 INFO:teuthology.orchestra.run.vm04.stdout:(108/136): python3-jaraco-8.2.1-3.el9.noarch.rp 4.5 MB/s | 11 kB 00:00 2026-03-09T15:30:23.834 INFO:teuthology.orchestra.run.vm04.stdout:(109/136): python3-jaraco-classes-3.2.1-5.el9.n 6.6 MB/s | 18 kB 00:00 2026-03-09T15:30:23.837 INFO:teuthology.orchestra.run.vm04.stdout:(110/136): python3-jaraco-collections-3.0.0-8.e 7.8 MB/s | 23 kB 00:00 2026-03-09T15:30:23.839 INFO:teuthology.orchestra.run.vm04.stdout:(111/136): python3-jaraco-context-6.0.1-3.el9.n 9.4 MB/s | 20 kB 00:00 2026-03-09T15:30:23.842 INFO:teuthology.orchestra.run.vm04.stdout:(112/136): python3-jaraco-functools-3.5.0-2.el9 8.0 MB/s | 19 kB 00:00 2026-03-09T15:30:23.845 INFO:teuthology.orchestra.run.vm04.stdout:(113/136): python3-jaraco-text-4.0.0-2.el9.noar 10 MB/s | 26 kB 00:00 2026-03-09T15:30:23.861 INFO:teuthology.orchestra.run.vm04.stdout:(114/136): python3-kubernetes-26.1.0-3.el9.noar 66 MB/s | 1.0 MB 00:00 2026-03-09T15:30:23.863 INFO:teuthology.orchestra.run.vm04.stdout:(115/136): python3-logutils-0.3.5-21.el9.noarch 17 MB/s | 46 kB 00:00 2026-03-09T15:30:23.867 INFO:teuthology.orchestra.run.vm04.stdout:(116/136): python3-more-itertools-8.12.0-2.el9. 25 MB/s | 79 kB 00:00 2026-03-09T15:30:23.870 INFO:teuthology.orchestra.run.vm04.stdout:(117/136): python3-natsort-7.1.1-5.el9.noarch.r 21 MB/s | 58 kB 00:00 2026-03-09T15:30:23.875 INFO:teuthology.orchestra.run.vm04.stdout:(118/136): python3-pecan-1.4.2-3.el9.noarch.rpm 49 MB/s | 272 kB 00:00 2026-03-09T15:30:23.879 INFO:teuthology.orchestra.run.vm04.stdout:(119/136): python3-portend-3.1.0-2.el9.noarch.r 4.0 MB/s | 16 kB 00:00 2026-03-09T15:30:23.884 INFO:teuthology.orchestra.run.vm04.stdout:(120/136): python3-pyOpenSSL-21.0.0-1.el9.noarc 19 MB/s | 90 kB 00:00 2026-03-09T15:30:23.887 INFO:teuthology.orchestra.run.vm04.stdout:(121/136): python3-repoze-lru-0.7-16.el9.noarch 13 MB/s | 31 kB 00:00 2026-03-09T15:30:23.890 INFO:teuthology.orchestra.run.vm04.stdout:(122/136): protobuf-compiler-3.14.0-17.el9.x86_ 2.1 MB/s | 862 kB 00:00 2026-03-09T15:30:23.893 INFO:teuthology.orchestra.run.vm04.stdout:(123/136): python3-routes-2.5.1-5.el9.noarch.rp 30 MB/s | 188 kB 00:00 2026-03-09T15:30:23.896 INFO:teuthology.orchestra.run.vm04.stdout:(124/136): python3-tempora-5.0.0-2.el9.noarch.r 15 MB/s | 36 kB 00:00 2026-03-09T15:30:23.897 INFO:teuthology.orchestra.run.vm04.stdout:(125/136): python3-rsa-4.9-2.el9.noarch.rpm 9.0 MB/s | 59 kB 00:00 2026-03-09T15:30:23.899 INFO:teuthology.orchestra.run.vm04.stdout:(126/136): python3-typing-extensions-4.15.0-1.e 30 MB/s | 86 kB 00:00 2026-03-09T15:30:23.902 INFO:teuthology.orchestra.run.vm04.stdout:(127/136): python3-websocket-client-1.2.3-2.el9 27 MB/s | 90 kB 00:00 2026-03-09T15:30:23.905 INFO:teuthology.orchestra.run.vm04.stdout:(128/136): python3-webob-1.8.8-2.el9.noarch.rpm 29 MB/s | 230 kB 00:00 2026-03-09T15:30:23.909 INFO:teuthology.orchestra.run.vm04.stdout:(129/136): python3-werkzeug-2.0.3-3.el9.1.noarc 61 MB/s | 427 kB 00:00 2026-03-09T15:30:23.910 INFO:teuthology.orchestra.run.vm04.stdout:(130/136): python3-xmltodict-0.12.0-15.el9.noar 5.3 MB/s | 22 kB 00:00 2026-03-09T15:30:23.911 INFO:teuthology.orchestra.run.vm04.stdout:(131/136): python3-zc-lockfile-2.0-10.el9.noarc 9.1 MB/s | 20 kB 00:00 2026-03-09T15:30:23.918 INFO:teuthology.orchestra.run.vm04.stdout:(132/136): re2-20211101-20.el9.x86_64.rpm 22 MB/s | 191 kB 00:00 2026-03-09T15:30:23.939 INFO:teuthology.orchestra.run.vm04.stdout:(133/136): thrift-0.15.0-4.el9.x86_64.rpm 58 MB/s | 1.6 MB 00:00 2026-03-09T15:30:24.080 INFO:teuthology.orchestra.run.vm03.stdout:(38/136): libgfortran-11.5.0-14.el9.x86_64.rpm 2.6 MB/s | 794 kB 00:00 2026-03-09T15:30:24.111 INFO:teuthology.orchestra.run.vm04.stdout:(134/136): python3-scipy-1.9.3-2.el9.x86_64.rpm 19 MB/s | 19 MB 00:01 2026-03-09T15:30:24.141 INFO:teuthology.orchestra.run.vm03.stdout:(39/136): libquadmath-11.5.0-14.el9.x86_64.rpm 3.0 MB/s | 184 kB 00:00 2026-03-09T15:30:24.172 INFO:teuthology.orchestra.run.vm03.stdout:(40/136): mailcap-2.1.49-5.el9.noarch.rpm 1.1 MB/s | 33 kB 00:00 2026-03-09T15:30:24.204 INFO:teuthology.orchestra.run.vm03.stdout:(41/136): pciutils-3.7.0-7.el9.x86_64.rpm 2.8 MB/s | 93 kB 00:00 2026-03-09T15:30:24.281 INFO:teuthology.orchestra.run.vm03.stdout:(42/136): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 253 kB 00:00 2026-03-09T15:30:24.525 INFO:teuthology.orchestra.run.vm03.stdout:(43/136): ceph-mgr-diskprediction-local-19.2.3- 3.8 MB/s | 7.4 MB 00:01 2026-03-09T15:30:24.604 INFO:teuthology.orchestra.run.vm03.stdout:(44/136): python3-cryptography-36.0.1-5.el9.x86 3.9 MB/s | 1.2 MB 00:00 2026-03-09T15:30:24.712 INFO:teuthology.orchestra.run.vm03.stdout:(45/136): python3-ply-3.11-14.el9.noarch.rpm 572 kB/s | 106 kB 00:00 2026-03-09T15:30:24.755 INFO:teuthology.orchestra.run.vm03.stdout:(46/136): python3-pycparser-2.20-6.el9.noarch.r 899 kB/s | 135 kB 00:00 2026-03-09T15:30:24.773 INFO:teuthology.orchestra.run.vm03.stdout:(47/136): python3-requests-2.25.1-10.el9.noarch 2.0 MB/s | 126 kB 00:00 2026-03-09T15:30:24.806 INFO:teuthology.orchestra.run.vm03.stdout:(48/136): unzip-6.0-59.el9.x86_64.rpm 5.5 MB/s | 182 kB 00:00 2026-03-09T15:30:24.815 INFO:teuthology.orchestra.run.vm03.stdout:(49/136): python3-urllib3-1.26.5-7.el9.noarch.r 3.5 MB/s | 218 kB 00:00 2026-03-09T15:30:24.840 INFO:teuthology.orchestra.run.vm03.stdout:(50/136): zip-3.0-35.el9.x86_64.rpm 7.8 MB/s | 266 kB 00:00 2026-03-09T15:30:24.924 INFO:teuthology.orchestra.run.vm03.stdout:(51/136): flexiblas-3.0.4-9.el9.x86_64.rpm 352 kB/s | 30 kB 00:00 2026-03-09T15:30:24.961 INFO:teuthology.orchestra.run.vm03.stdout:(52/136): boost-program-options-1.75.0-13.el9.x 716 kB/s | 104 kB 00:00 2026-03-09T15:30:24.978 INFO:teuthology.orchestra.run.vm04.stdout:(135/136): librados2-19.2.3-678.ge911bdeb.el9.x 3.2 MB/s | 3.4 MB 00:01 2026-03-09T15:30:24.986 INFO:teuthology.orchestra.run.vm03.stdout:(53/136): flexiblas-openblas-openmp-3.0.4-9.el9 589 kB/s | 15 kB 00:00 2026-03-09T15:30:25.034 INFO:teuthology.orchestra.run.vm03.stdout:(54/136): libnbd-1.20.3-4.el9.x86_64.rpm 3.4 MB/s | 164 kB 00:00 2026-03-09T15:30:25.067 INFO:teuthology.orchestra.run.vm03.stdout:(55/136): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 160 kB 00:00 2026-03-09T15:30:25.102 INFO:teuthology.orchestra.run.vm03.stdout:(56/136): flexiblas-netlib-3.0.4-9.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2026-03-09T15:30:25.103 INFO:teuthology.orchestra.run.vm03.stdout:(57/136): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.2 MB/s | 45 kB 00:00 2026-03-09T15:30:25.136 INFO:teuthology.orchestra.run.vm03.stdout:(58/136): librdkafka-1.6.1-102.el9.x86_64.rpm 19 MB/s | 662 kB 00:00 2026-03-09T15:30:25.141 INFO:teuthology.orchestra.run.vm03.stdout:(59/136): libstoragemgmt-1.10.1-1.el9.x86_64.rp 6.4 MB/s | 246 kB 00:00 2026-03-09T15:30:25.175 INFO:teuthology.orchestra.run.vm03.stdout:(60/136): libxslt-1.1.34-12.el9.x86_64.rpm 6.0 MB/s | 233 kB 00:00 2026-03-09T15:30:25.180 INFO:teuthology.orchestra.run.vm03.stdout:(61/136): lttng-ust-2.12.0-6.el9.x86_64.rpm 7.3 MB/s | 292 kB 00:00 2026-03-09T15:30:25.201 INFO:teuthology.orchestra.run.vm03.stdout:(62/136): lua-5.4.4-4.el9.x86_64.rpm 7.2 MB/s | 188 kB 00:00 2026-03-09T15:30:25.209 INFO:teuthology.orchestra.run.vm03.stdout:(63/136): openblas-0.3.29-1.el9.x86_64.rpm 1.5 MB/s | 42 kB 00:00 2026-03-09T15:30:25.281 INFO:teuthology.orchestra.run.vm03.stdout:(64/136): protobuf-3.14.0-17.el9.x86_64.rpm 14 MB/s | 1.0 MB 00:00 2026-03-09T15:30:25.340 INFO:teuthology.orchestra.run.vm03.stdout:(65/136): openblas-openmp-0.3.29-1.el9.x86_64.r 38 MB/s | 5.3 MB 00:00 2026-03-09T15:30:25.340 INFO:teuthology.orchestra.run.vm04.stdout:(136/136): librbd1-19.2.3-678.ge911bdeb.el9.x86 2.3 MB/s | 3.2 MB 00:01 2026-03-09T15:30:25.342 INFO:teuthology.orchestra.run.vm04.stdout:-------------------------------------------------------------------------------- 2026-03-09T15:30:25.342 INFO:teuthology.orchestra.run.vm04.stdout:Total 15 MB/s | 210 MB 00:13 2026-03-09T15:30:25.371 INFO:teuthology.orchestra.run.vm03.stdout:(66/136): python3-devel-3.9.25-3.el9.x86_64.rpm 7.8 MB/s | 244 kB 00:00 2026-03-09T15:30:25.400 INFO:teuthology.orchestra.run.vm03.stdout:(67/136): python3-jinja2-2.11.3-8.el9.noarch.rp 8.4 MB/s | 249 kB 00:00 2026-03-09T15:30:25.434 INFO:teuthology.orchestra.run.vm03.stdout:(68/136): python3-babel-2.9.1-2.el9.noarch.rpm 39 MB/s | 6.0 MB 00:00 2026-03-09T15:30:25.435 INFO:teuthology.orchestra.run.vm03.stdout:(69/136): python3-jmespath-1.0.1-1.el9.noarch.r 1.3 MB/s | 48 kB 00:00 2026-03-09T15:30:25.460 INFO:teuthology.orchestra.run.vm03.stdout:(70/136): python3-mako-1.1.4-6.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2026-03-09T15:30:25.462 INFO:teuthology.orchestra.run.vm03.stdout:(71/136): python3-libstoragemgmt-1.10.1-1.el9.x 6.3 MB/s | 177 kB 00:00 2026-03-09T15:30:25.484 INFO:teuthology.orchestra.run.vm03.stdout:(72/136): python3-markupsafe-1.1.1-12.el9.x86_6 1.5 MB/s | 35 kB 00:00 2026-03-09T15:30:25.515 INFO:teuthology.orchestra.run.vm03.stdout:(73/136): python3-numpy-f2py-1.23.5-2.el9.x86_6 14 MB/s | 442 kB 00:00 2026-03-09T15:30:25.542 INFO:teuthology.orchestra.run.vm03.stdout:(74/136): python3-packaging-20.9-5.el9.noarch.r 3.0 MB/s | 77 kB 00:00 2026-03-09T15:30:25.573 INFO:teuthology.orchestra.run.vm03.stdout:(75/136): python3-protobuf-3.14.0-17.el9.noarch 8.1 MB/s | 267 kB 00:00 2026-03-09T15:30:25.616 INFO:teuthology.orchestra.run.vm03.stdout:(76/136): python3-numpy-1.23.5-2.el9.x86_64.rpm 40 MB/s | 6.1 MB 00:00 2026-03-09T15:30:25.617 INFO:teuthology.orchestra.run.vm03.stdout:(77/136): python3-pyasn1-0.4.8-7.el9.noarch.rpm 3.5 MB/s | 157 kB 00:00 2026-03-09T15:30:25.643 INFO:teuthology.orchestra.run.vm03.stdout:(78/136): python3-requests-oauthlib-1.3.0-12.el 2.1 MB/s | 54 kB 00:00 2026-03-09T15:30:25.644 INFO:teuthology.orchestra.run.vm03.stdout:(79/136): python3-pyasn1-modules-0.4.8-7.el9.no 9.6 MB/s | 277 kB 00:00 2026-03-09T15:30:25.674 INFO:teuthology.orchestra.run.vm03.stdout:(80/136): python3-toml-0.10.2-6.el9.noarch.rpm 1.4 MB/s | 42 kB 00:00 2026-03-09T15:30:25.703 INFO:teuthology.orchestra.run.vm03.stdout:(81/136): qatlib-25.08.0-2.el9.x86_64.rpm 8.0 MB/s | 240 kB 00:00 2026-03-09T15:30:25.728 INFO:teuthology.orchestra.run.vm03.stdout:(82/136): qatlib-service-25.08.0-2.el9.x86_64.r 1.5 MB/s | 37 kB 00:00 2026-03-09T15:30:25.752 INFO:teuthology.orchestra.run.vm03.stdout:(83/136): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.7 MB/s | 66 kB 00:00 2026-03-09T15:30:25.789 INFO:teuthology.orchestra.run.vm03.stdout:(84/136): socat-1.7.4.1-8.el9.x86_64.rpm 8.1 MB/s | 303 kB 00:00 2026-03-09T15:30:25.812 INFO:teuthology.orchestra.run.vm03.stdout:(85/136): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.7 MB/s | 64 kB 00:00 2026-03-09T15:30:25.865 INFO:teuthology.orchestra.run.vm03.stdout:(86/136): lua-devel-5.4.4-4.el9.x86_64.rpm 428 kB/s | 22 kB 00:00 2026-03-09T15:30:25.933 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction check 2026-03-09T15:30:25.960 INFO:teuthology.orchestra.run.vm03.stdout:(87/136): protobuf-compiler-3.14.0-17.el9.x86_6 8.9 MB/s | 862 kB 00:00 2026-03-09T15:30:25.986 INFO:teuthology.orchestra.run.vm04.stdout:Transaction check succeeded. 2026-03-09T15:30:25.986 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction test 2026-03-09T15:30:25.995 INFO:teuthology.orchestra.run.vm03.stdout:(88/136): abseil-cpp-20211102.0-4.el9.x86_64.rp 16 MB/s | 551 kB 00:00 2026-03-09T15:30:26.004 INFO:teuthology.orchestra.run.vm03.stdout:(89/136): gperftools-libs-2.9.1-3.el9.x86_64.rp 35 MB/s | 308 kB 00:00 2026-03-09T15:30:26.006 INFO:teuthology.orchestra.run.vm03.stdout:(90/136): grpc-data-1.46.7-10.el9.noarch.rpm 8.9 MB/s | 19 kB 00:00 2026-03-09T15:30:26.092 INFO:teuthology.orchestra.run.vm03.stdout:(91/136): python3-scipy-1.9.3-2.el9.x86_64.rpm 43 MB/s | 19 MB 00:00 2026-03-09T15:30:26.098 INFO:teuthology.orchestra.run.vm03.stdout:(92/136): libarrow-doc-9.0.0-15.el9.noarch.rpm 4.2 MB/s | 25 kB 00:00 2026-03-09T15:30:26.103 INFO:teuthology.orchestra.run.vm03.stdout:(93/136): liboath-2.6.12-1.el9.x86_64.rpm 10 MB/s | 49 kB 00:00 2026-03-09T15:30:26.110 INFO:teuthology.orchestra.run.vm03.stdout:(94/136): libunwind-1.6.2-1.el9.x86_64.rpm 9.9 MB/s | 67 kB 00:00 2026-03-09T15:30:26.130 INFO:teuthology.orchestra.run.vm03.stdout:(95/136): libarrow-9.0.0-15.el9.x86_64.rpm 36 MB/s | 4.4 MB 00:00 2026-03-09T15:30:26.132 INFO:teuthology.orchestra.run.vm03.stdout:(96/136): luarocks-3.9.2-5.el9.noarch.rpm 6.7 MB/s | 151 kB 00:00 2026-03-09T15:30:26.142 INFO:teuthology.orchestra.run.vm03.stdout:(97/136): parquet-libs-9.0.0-15.el9.x86_64.rpm 70 MB/s | 838 kB 00:00 2026-03-09T15:30:26.144 INFO:teuthology.orchestra.run.vm03.stdout:(98/136): python3-autocommand-2.2.2-8.el9.noarc 14 MB/s | 29 kB 00:00 2026-03-09T15:30:26.147 INFO:teuthology.orchestra.run.vm03.stdout:(99/136): python3-backports-tarfile-1.2.0-1.el9 24 MB/s | 60 kB 00:00 2026-03-09T15:30:26.149 INFO:teuthology.orchestra.run.vm03.stdout:(100/136): python3-bcrypt-3.2.2-1.el9.x86_64.rp 19 MB/s | 43 kB 00:00 2026-03-09T15:30:26.153 INFO:teuthology.orchestra.run.vm03.stdout:(101/136): python3-asyncssh-2.13.2-5.el9.noarch 26 MB/s | 548 kB 00:00 2026-03-09T15:30:26.153 INFO:teuthology.orchestra.run.vm03.stdout:(102/136): python3-cachetools-4.2.4-1.el9.noarc 8.7 MB/s | 32 kB 00:00 2026-03-09T15:30:26.155 INFO:teuthology.orchestra.run.vm03.stdout:(103/136): python3-certifi-2023.05.07-4.el9.noa 6.5 MB/s | 14 kB 00:00 2026-03-09T15:30:26.157 INFO:teuthology.orchestra.run.vm03.stdout:(104/136): python3-cheroot-10.0.1-4.el9.noarch. 44 MB/s | 173 kB 00:00 2026-03-09T15:30:26.162 INFO:teuthology.orchestra.run.vm03.stdout:(105/136): python3-google-auth-2.45.0-1.el9.noa 52 MB/s | 254 kB 00:00 2026-03-09T15:30:26.169 INFO:teuthology.orchestra.run.vm03.stdout:(106/136): python3-cherrypy-18.6.1-2.el9.noarch 26 MB/s | 358 kB 00:00 2026-03-09T15:30:26.179 INFO:teuthology.orchestra.run.vm03.stdout:(107/136): python3-grpcio-tools-1.46.7-10.el9.x 15 MB/s | 144 kB 00:00 2026-03-09T15:30:26.183 INFO:teuthology.orchestra.run.vm03.stdout:(108/136): python3-jaraco-8.2.1-3.el9.noarch.rp 2.4 MB/s | 11 kB 00:00 2026-03-09T15:30:26.190 INFO:teuthology.orchestra.run.vm03.stdout:(109/136): python3-grpcio-1.46.7-10.el9.x86_64. 75 MB/s | 2.0 MB 00:00 2026-03-09T15:30:26.190 INFO:teuthology.orchestra.run.vm03.stdout:(110/136): python3-jaraco-classes-3.2.1-5.el9.n 2.5 MB/s | 18 kB 00:00 2026-03-09T15:30:26.192 INFO:teuthology.orchestra.run.vm03.stdout:(111/136): python3-jaraco-collections-3.0.0-8.e 11 MB/s | 23 kB 00:00 2026-03-09T15:30:26.192 INFO:teuthology.orchestra.run.vm03.stdout:(112/136): python3-jaraco-context-6.0.1-3.el9.n 9.8 MB/s | 20 kB 00:00 2026-03-09T15:30:26.194 INFO:teuthology.orchestra.run.vm03.stdout:(113/136): python3-jaraco-functools-3.5.0-2.el9 9.9 MB/s | 19 kB 00:00 2026-03-09T15:30:26.195 INFO:teuthology.orchestra.run.vm03.stdout:(114/136): python3-jaraco-text-4.0.0-2.el9.noar 12 MB/s | 26 kB 00:00 2026-03-09T15:30:26.208 INFO:teuthology.orchestra.run.vm03.stdout:(115/136): python3-kubernetes-26.1.0-3.el9.noar 75 MB/s | 1.0 MB 00:00 2026-03-09T15:30:26.211 INFO:teuthology.orchestra.run.vm03.stdout:(116/136): python3-more-itertools-8.12.0-2.el9. 28 MB/s | 79 kB 00:00 2026-03-09T15:30:26.213 INFO:teuthology.orchestra.run.vm03.stdout:(117/136): python3-logutils-0.3.5-21.el9.noarch 2.5 MB/s | 46 kB 00:00 2026-03-09T15:30:26.214 INFO:teuthology.orchestra.run.vm03.stdout:(118/136): python3-natsort-7.1.1-5.el9.noarch.r 16 MB/s | 58 kB 00:00 2026-03-09T15:30:26.218 INFO:teuthology.orchestra.run.vm03.stdout:(119/136): python3-portend-3.1.0-2.el9.noarch.r 5.0 MB/s | 16 kB 00:00 2026-03-09T15:30:26.219 INFO:teuthology.orchestra.run.vm03.stdout:(120/136): python3-pecan-1.4.2-3.el9.noarch.rpm 50 MB/s | 272 kB 00:00 2026-03-09T15:30:26.221 INFO:teuthology.orchestra.run.vm03.stdout:(121/136): python3-repoze-lru-0.7-16.el9.noarch 15 MB/s | 31 kB 00:00 2026-03-09T15:30:26.221 INFO:teuthology.orchestra.run.vm03.stdout:(122/136): python3-pyOpenSSL-21.0.0-1.el9.noarc 24 MB/s | 90 kB 00:00 2026-03-09T15:30:26.225 INFO:teuthology.orchestra.run.vm03.stdout:(123/136): python3-routes-2.5.1-5.el9.noarch.rp 47 MB/s | 188 kB 00:00 2026-03-09T15:30:26.226 INFO:teuthology.orchestra.run.vm03.stdout:(124/136): python3-rsa-4.9-2.el9.noarch.rpm 14 MB/s | 59 kB 00:00 2026-03-09T15:30:26.228 INFO:teuthology.orchestra.run.vm03.stdout:(125/136): python3-tempora-5.0.0-2.el9.noarch.r 14 MB/s | 36 kB 00:00 2026-03-09T15:30:26.230 INFO:teuthology.orchestra.run.vm03.stdout:(126/136): python3-typing-extensions-4.15.0-1.e 22 MB/s | 86 kB 00:00 2026-03-09T15:30:26.233 INFO:teuthology.orchestra.run.vm03.stdout:(127/136): python3-webob-1.8.8-2.el9.noarch.rpm 46 MB/s | 230 kB 00:00 2026-03-09T15:30:26.234 INFO:teuthology.orchestra.run.vm03.stdout:(128/136): python3-websocket-client-1.2.3-2.el9 22 MB/s | 90 kB 00:00 2026-03-09T15:30:26.238 INFO:teuthology.orchestra.run.vm03.stdout:(129/136): python3-xmltodict-0.12.0-15.el9.noar 5.4 MB/s | 22 kB 00:00 2026-03-09T15:30:26.240 INFO:teuthology.orchestra.run.vm03.stdout:(130/136): python3-werkzeug-2.0.3-3.el9.1.noarc 62 MB/s | 427 kB 00:00 2026-03-09T15:30:26.240 INFO:teuthology.orchestra.run.vm03.stdout:(131/136): python3-zc-lockfile-2.0-10.el9.noarc 8.9 MB/s | 20 kB 00:00 2026-03-09T15:30:26.244 INFO:teuthology.orchestra.run.vm03.stdout:(132/136): re2-20211101-20.el9.x86_64.rpm 45 MB/s | 191 kB 00:00 2026-03-09T15:30:26.276 INFO:teuthology.orchestra.run.vm03.stdout:(133/136): thrift-0.15.0-4.el9.x86_64.rpm 44 MB/s | 1.6 MB 00:00 2026-03-09T15:30:26.861 INFO:teuthology.orchestra.run.vm04.stdout:Transaction test succeeded. 2026-03-09T15:30:26.861 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction 2026-03-09T15:30:27.764 INFO:teuthology.orchestra.run.vm04.stdout: Preparing : 1/1 2026-03-09T15:30:27.778 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/138 2026-03-09T15:30:27.791 INFO:teuthology.orchestra.run.vm04.stdout: Installing : thrift-0.15.0-4.el9.x86_64 2/138 2026-03-09T15:30:27.966 INFO:teuthology.orchestra.run.vm04.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 3/138 2026-03-09T15:30:27.976 INFO:teuthology.orchestra.run.vm04.stdout: Upgrading : librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T15:30:28.036 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T15:30:28.038 INFO:teuthology.orchestra.run.vm04.stdout: Installing : libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 5/138 2026-03-09T15:30:28.068 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 5/138 2026-03-09T15:30:28.077 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 6/138 2026-03-09T15:30:28.081 INFO:teuthology.orchestra.run.vm04.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/138 2026-03-09T15:30:28.083 INFO:teuthology.orchestra.run.vm04.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/138 2026-03-09T15:30:28.088 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/138 2026-03-09T15:30:28.100 INFO:teuthology.orchestra.run.vm04.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 10/138 2026-03-09T15:30:28.101 INFO:teuthology.orchestra.run.vm04.stdout: Installing : libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T15:30:28.138 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T15:30:28.139 INFO:teuthology.orchestra.run.vm04.stdout: Installing : libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 12/138 2026-03-09T15:30:28.154 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 12/138 2026-03-09T15:30:28.190 INFO:teuthology.orchestra.run.vm04.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/138 2026-03-09T15:30:28.228 INFO:teuthology.orchestra.run.vm04.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/138 2026-03-09T15:30:28.233 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 15/138 2026-03-09T15:30:28.258 INFO:teuthology.orchestra.run.vm04.stdout: Installing : liboath-2.6.12-1.el9.x86_64 16/138 2026-03-09T15:30:28.271 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 17/138 2026-03-09T15:30:28.280 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/138 2026-03-09T15:30:28.293 INFO:teuthology.orchestra.run.vm03.stdout:(134/136): librbd1-19.2.3-678.ge911bdeb.el9.x86 1.6 MB/s | 3.2 MB 00:02 2026-03-09T15:30:28.302 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/138 2026-03-09T15:30:28.309 INFO:teuthology.orchestra.run.vm04.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 20/138 2026-03-09T15:30:28.313 INFO:teuthology.orchestra.run.vm04.stdout: Installing : lua-5.4.4-4.el9.x86_64 21/138 2026-03-09T15:30:28.319 INFO:teuthology.orchestra.run.vm04.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 22/138 2026-03-09T15:30:28.349 INFO:teuthology.orchestra.run.vm04.stdout: Installing : unzip-6.0-59.el9.x86_64 23/138 2026-03-09T15:30:28.365 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 24/138 2026-03-09T15:30:28.370 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 25/138 2026-03-09T15:30:28.377 INFO:teuthology.orchestra.run.vm04.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 26/138 2026-03-09T15:30:28.380 INFO:teuthology.orchestra.run.vm04.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 27/138 2026-03-09T15:30:28.399 INFO:teuthology.orchestra.run.vm03.stdout:(135/136): librados2-19.2.3-678.ge911bdeb.el9.x 1.6 MB/s | 3.4 MB 00:02 2026-03-09T15:30:28.411 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 28/138 2026-03-09T15:30:28.418 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x 29/138 2026-03-09T15:30:28.428 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9 30/138 2026-03-09T15:30:28.443 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 31/138 2026-03-09T15:30:28.450 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 32/138 2026-03-09T15:30:28.480 INFO:teuthology.orchestra.run.vm04.stdout: Installing : zip-3.0-35.el9.x86_64 33/138 2026-03-09T15:30:28.487 INFO:teuthology.orchestra.run.vm04.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/138 2026-03-09T15:30:28.495 INFO:teuthology.orchestra.run.vm04.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/138 2026-03-09T15:30:28.525 INFO:teuthology.orchestra.run.vm04.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 36/138 2026-03-09T15:30:28.586 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/138 2026-03-09T15:30:28.604 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 38/138 2026-03-09T15:30:28.612 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/138 2026-03-09T15:30:28.621 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/138 2026-03-09T15:30:28.628 INFO:teuthology.orchestra.run.vm04.stdout: Installing : librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 41/138 2026-03-09T15:30:28.633 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 42/138 2026-03-09T15:30:28.650 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 43/138 2026-03-09T15:30:28.677 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 44/138 2026-03-09T15:30:28.684 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 45/138 2026-03-09T15:30:28.691 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 46/138 2026-03-09T15:30:28.706 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 47/138 2026-03-09T15:30:28.718 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 48/138 2026-03-09T15:30:28.730 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 49/138 2026-03-09T15:30:28.795 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 50/138 2026-03-09T15:30:28.803 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 51/138 2026-03-09T15:30:28.813 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 52/138 2026-03-09T15:30:28.862 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 53/138 2026-03-09T15:30:29.244 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 54/138 2026-03-09T15:30:29.262 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 55/138 2026-03-09T15:30:29.268 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 56/138 2026-03-09T15:30:29.276 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 57/138 2026-03-09T15:30:29.281 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 58/138 2026-03-09T15:30:29.289 INFO:teuthology.orchestra.run.vm04.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/138 2026-03-09T15:30:29.294 INFO:teuthology.orchestra.run.vm04.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 60/138 2026-03-09T15:30:29.296 INFO:teuthology.orchestra.run.vm04.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 61/138 2026-03-09T15:30:29.327 INFO:teuthology.orchestra.run.vm04.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 62/138 2026-03-09T15:30:29.380 INFO:teuthology.orchestra.run.vm04.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 63/138 2026-03-09T15:30:29.394 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 64/138 2026-03-09T15:30:29.402 INFO:teuthology.orchestra.run.vm04.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 65/138 2026-03-09T15:30:29.408 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/138 2026-03-09T15:30:29.416 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/138 2026-03-09T15:30:29.423 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 68/138 2026-03-09T15:30:29.433 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/138 2026-03-09T15:30:29.439 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/138 2026-03-09T15:30:29.474 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/138 2026-03-09T15:30:29.488 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 72/138 2026-03-09T15:30:29.536 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/138 2026-03-09T15:30:29.815 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 74/138 2026-03-09T15:30:29.847 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 75/138 2026-03-09T15:30:29.856 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 76/138 2026-03-09T15:30:29.922 INFO:teuthology.orchestra.run.vm04.stdout: Installing : openblas-0.3.29-1.el9.x86_64 77/138 2026-03-09T15:30:29.925 INFO:teuthology.orchestra.run.vm04.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 78/138 2026-03-09T15:30:29.949 INFO:teuthology.orchestra.run.vm04.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 79/138 2026-03-09T15:30:30.347 INFO:teuthology.orchestra.run.vm04.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 80/138 2026-03-09T15:30:30.441 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 81/138 2026-03-09T15:30:31.246 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 82/138 2026-03-09T15:30:31.274 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 83/138 2026-03-09T15:30:31.280 INFO:teuthology.orchestra.run.vm04.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 84/138 2026-03-09T15:30:31.285 INFO:teuthology.orchestra.run.vm04.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 85/138 2026-03-09T15:30:31.446 INFO:teuthology.orchestra.run.vm04.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 86/138 2026-03-09T15:30:31.449 INFO:teuthology.orchestra.run.vm04.stdout: Upgrading : librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 87/138 2026-03-09T15:30:31.487 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 87/138 2026-03-09T15:30:31.491 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 88/138 2026-03-09T15:30:31.499 INFO:teuthology.orchestra.run.vm04.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 89/138 2026-03-09T15:30:31.755 INFO:teuthology.orchestra.run.vm04.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 90/138 2026-03-09T15:30:31.758 INFO:teuthology.orchestra.run.vm04.stdout: Installing : librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 91/138 2026-03-09T15:30:31.777 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 91/138 2026-03-09T15:30:31.779 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 92/138 2026-03-09T15:30:32.941 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T15:30:32.946 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T15:30:32.973 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T15:30:32.992 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-ply-3.11-14.el9.noarch 94/138 2026-03-09T15:30:33.011 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 95/138 2026-03-09T15:30:33.108 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 96/138 2026-03-09T15:30:33.122 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 97/138 2026-03-09T15:30:33.154 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 98/138 2026-03-09T15:30:33.192 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 99/138 2026-03-09T15:30:33.255 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 100/138 2026-03-09T15:30:33.267 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 101/138 2026-03-09T15:30:33.272 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 102/138 2026-03-09T15:30:33.279 INFO:teuthology.orchestra.run.vm04.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 103/138 2026-03-09T15:30:33.284 INFO:teuthology.orchestra.run.vm04.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 104/138 2026-03-09T15:30:33.286 INFO:teuthology.orchestra.run.vm04.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 105/138 2026-03-09T15:30:33.304 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 105/138 2026-03-09T15:30:33.624 INFO:teuthology.orchestra.run.vm04.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 106/138 2026-03-09T15:30:33.669 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 107/138 2026-03-09T15:30:33.720 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 107/138 2026-03-09T15:30:33.720 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-03-09T15:30:33.720 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-03-09T15:30:33.720 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:33.729 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 108/138 2026-03-09T15:30:34.238 INFO:teuthology.orchestra.run.vm03.stdout:(136/136): ceph-test-19.2.3-678.ge911bdeb.el9.x 3.2 MB/s | 50 MB 00:15 2026-03-09T15:30:34.240 INFO:teuthology.orchestra.run.vm03.stdout:-------------------------------------------------------------------------------- 2026-03-09T15:30:34.240 INFO:teuthology.orchestra.run.vm03.stdout:Total 10 MB/s | 210 MB 00:21 2026-03-09T15:30:34.782 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction check 2026-03-09T15:30:34.830 INFO:teuthology.orchestra.run.vm03.stdout:Transaction check succeeded. 2026-03-09T15:30:34.830 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction test 2026-03-09T15:30:35.645 INFO:teuthology.orchestra.run.vm03.stdout:Transaction test succeeded. 2026-03-09T15:30:35.645 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction 2026-03-09T15:30:36.552 INFO:teuthology.orchestra.run.vm03.stdout: Preparing : 1/1 2026-03-09T15:30:36.567 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/138 2026-03-09T15:30:36.579 INFO:teuthology.orchestra.run.vm03.stdout: Installing : thrift-0.15.0-4.el9.x86_64 2/138 2026-03-09T15:30:36.749 INFO:teuthology.orchestra.run.vm03.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 3/138 2026-03-09T15:30:36.751 INFO:teuthology.orchestra.run.vm03.stdout: Upgrading : librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T15:30:36.810 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T15:30:36.811 INFO:teuthology.orchestra.run.vm03.stdout: Installing : libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 5/138 2026-03-09T15:30:36.839 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 5/138 2026-03-09T15:30:36.849 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 6/138 2026-03-09T15:30:36.852 INFO:teuthology.orchestra.run.vm03.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/138 2026-03-09T15:30:36.854 INFO:teuthology.orchestra.run.vm03.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/138 2026-03-09T15:30:36.860 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/138 2026-03-09T15:30:36.869 INFO:teuthology.orchestra.run.vm03.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 10/138 2026-03-09T15:30:36.871 INFO:teuthology.orchestra.run.vm03.stdout: Installing : libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T15:30:36.905 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T15:30:36.907 INFO:teuthology.orchestra.run.vm03.stdout: Installing : libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 12/138 2026-03-09T15:30:36.921 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 12/138 2026-03-09T15:30:36.954 INFO:teuthology.orchestra.run.vm03.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/138 2026-03-09T15:30:36.990 INFO:teuthology.orchestra.run.vm03.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/138 2026-03-09T15:30:36.996 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 15/138 2026-03-09T15:30:37.020 INFO:teuthology.orchestra.run.vm03.stdout: Installing : liboath-2.6.12-1.el9.x86_64 16/138 2026-03-09T15:30:37.034 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 17/138 2026-03-09T15:30:37.041 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/138 2026-03-09T15:30:37.051 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/138 2026-03-09T15:30:37.058 INFO:teuthology.orchestra.run.vm03.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 20/138 2026-03-09T15:30:37.062 INFO:teuthology.orchestra.run.vm03.stdout: Installing : lua-5.4.4-4.el9.x86_64 21/138 2026-03-09T15:30:37.067 INFO:teuthology.orchestra.run.vm03.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 22/138 2026-03-09T15:30:37.094 INFO:teuthology.orchestra.run.vm03.stdout: Installing : unzip-6.0-59.el9.x86_64 23/138 2026-03-09T15:30:37.111 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 24/138 2026-03-09T15:30:37.115 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 25/138 2026-03-09T15:30:37.123 INFO:teuthology.orchestra.run.vm03.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 26/138 2026-03-09T15:30:37.125 INFO:teuthology.orchestra.run.vm03.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 27/138 2026-03-09T15:30:37.156 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 28/138 2026-03-09T15:30:37.163 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x 29/138 2026-03-09T15:30:37.174 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9 30/138 2026-03-09T15:30:37.188 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 31/138 2026-03-09T15:30:37.197 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 32/138 2026-03-09T15:30:37.226 INFO:teuthology.orchestra.run.vm03.stdout: Installing : zip-3.0-35.el9.x86_64 33/138 2026-03-09T15:30:37.232 INFO:teuthology.orchestra.run.vm03.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/138 2026-03-09T15:30:37.240 INFO:teuthology.orchestra.run.vm03.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/138 2026-03-09T15:30:37.270 INFO:teuthology.orchestra.run.vm03.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 36/138 2026-03-09T15:30:37.329 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/138 2026-03-09T15:30:37.345 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 38/138 2026-03-09T15:30:37.353 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/138 2026-03-09T15:30:37.362 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/138 2026-03-09T15:30:37.369 INFO:teuthology.orchestra.run.vm03.stdout: Installing : librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 41/138 2026-03-09T15:30:37.373 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 42/138 2026-03-09T15:30:37.391 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 43/138 2026-03-09T15:30:37.416 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 44/138 2026-03-09T15:30:37.423 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 45/138 2026-03-09T15:30:37.430 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 46/138 2026-03-09T15:30:37.444 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 47/138 2026-03-09T15:30:37.457 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 48/138 2026-03-09T15:30:37.469 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 49/138 2026-03-09T15:30:37.535 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 50/138 2026-03-09T15:30:37.544 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 51/138 2026-03-09T15:30:37.554 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 52/138 2026-03-09T15:30:37.604 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 53/138 2026-03-09T15:30:38.001 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 54/138 2026-03-09T15:30:38.019 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 55/138 2026-03-09T15:30:38.025 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 56/138 2026-03-09T15:30:38.033 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 57/138 2026-03-09T15:30:38.039 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 58/138 2026-03-09T15:30:38.046 INFO:teuthology.orchestra.run.vm03.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/138 2026-03-09T15:30:38.050 INFO:teuthology.orchestra.run.vm03.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 60/138 2026-03-09T15:30:38.052 INFO:teuthology.orchestra.run.vm03.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 61/138 2026-03-09T15:30:38.083 INFO:teuthology.orchestra.run.vm03.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 62/138 2026-03-09T15:30:38.135 INFO:teuthology.orchestra.run.vm03.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 63/138 2026-03-09T15:30:38.150 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 64/138 2026-03-09T15:30:38.157 INFO:teuthology.orchestra.run.vm03.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 65/138 2026-03-09T15:30:38.163 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/138 2026-03-09T15:30:38.171 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/138 2026-03-09T15:30:38.177 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 68/138 2026-03-09T15:30:38.187 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/138 2026-03-09T15:30:38.193 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/138 2026-03-09T15:30:38.227 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/138 2026-03-09T15:30:38.240 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 72/138 2026-03-09T15:30:38.284 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/138 2026-03-09T15:30:38.552 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 74/138 2026-03-09T15:30:38.586 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 75/138 2026-03-09T15:30:38.594 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 76/138 2026-03-09T15:30:38.667 INFO:teuthology.orchestra.run.vm03.stdout: Installing : openblas-0.3.29-1.el9.x86_64 77/138 2026-03-09T15:30:38.671 INFO:teuthology.orchestra.run.vm03.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 78/138 2026-03-09T15:30:38.695 INFO:teuthology.orchestra.run.vm03.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 79/138 2026-03-09T15:30:39.086 INFO:teuthology.orchestra.run.vm03.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 80/138 2026-03-09T15:30:39.294 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 81/138 2026-03-09T15:30:40.004 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 108/138 2026-03-09T15:30:40.004 INFO:teuthology.orchestra.run.vm04.stdout:skipping the directory /sys 2026-03-09T15:30:40.004 INFO:teuthology.orchestra.run.vm04.stdout:skipping the directory /proc 2026-03-09T15:30:40.004 INFO:teuthology.orchestra.run.vm04.stdout:skipping the directory /mnt 2026-03-09T15:30:40.004 INFO:teuthology.orchestra.run.vm04.stdout:skipping the directory /var/tmp 2026-03-09T15:30:40.004 INFO:teuthology.orchestra.run.vm04.stdout:skipping the directory /home 2026-03-09T15:30:40.004 INFO:teuthology.orchestra.run.vm04.stdout:skipping the directory /root 2026-03-09T15:30:40.004 INFO:teuthology.orchestra.run.vm04.stdout:skipping the directory /tmp 2026-03-09T15:30:40.004 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:40.130 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 109/138 2026-03-09T15:30:40.156 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 109/138 2026-03-09T15:30:40.156 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:40.156 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-03-09T15:30:40.156 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-03-09T15:30:40.156 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-03-09T15:30:40.156 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:40.218 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 82/138 2026-03-09T15:30:40.247 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 83/138 2026-03-09T15:30:40.253 INFO:teuthology.orchestra.run.vm03.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 84/138 2026-03-09T15:30:40.258 INFO:teuthology.orchestra.run.vm03.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 85/138 2026-03-09T15:30:40.389 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 110/138 2026-03-09T15:30:40.411 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 110/138 2026-03-09T15:30:40.411 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:40.411 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-03-09T15:30:40.411 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-03-09T15:30:40.411 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-03-09T15:30:40.411 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:40.417 INFO:teuthology.orchestra.run.vm03.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 86/138 2026-03-09T15:30:40.420 INFO:teuthology.orchestra.run.vm04.stdout: Installing : mailcap-2.1.49-5.el9.noarch 111/138 2026-03-09T15:30:40.420 INFO:teuthology.orchestra.run.vm03.stdout: Upgrading : librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 87/138 2026-03-09T15:30:40.423 INFO:teuthology.orchestra.run.vm04.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 112/138 2026-03-09T15:30:40.440 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T15:30:40.440 INFO:teuthology.orchestra.run.vm04.stdout:Creating group 'qat' with GID 994. 2026-03-09T15:30:40.440 INFO:teuthology.orchestra.run.vm04.stdout:Creating group 'libstoragemgmt' with GID 993. 2026-03-09T15:30:40.440 INFO:teuthology.orchestra.run.vm04.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 993 and GID 993. 2026-03-09T15:30:40.440 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:40.451 INFO:teuthology.orchestra.run.vm04.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T15:30:40.454 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 87/138 2026-03-09T15:30:40.457 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 88/138 2026-03-09T15:30:40.466 INFO:teuthology.orchestra.run.vm03.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 89/138 2026-03-09T15:30:40.484 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T15:30:40.484 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-03-09T15:30:40.484 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:40.528 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 114/138 2026-03-09T15:30:40.605 INFO:teuthology.orchestra.run.vm04.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 115/138 2026-03-09T15:30:40.609 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 116/138 2026-03-09T15:30:40.624 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 116/138 2026-03-09T15:30:40.624 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:40.624 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-03-09T15:30:40.624 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:40.728 INFO:teuthology.orchestra.run.vm03.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 90/138 2026-03-09T15:30:40.731 INFO:teuthology.orchestra.run.vm03.stdout: Installing : librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 91/138 2026-03-09T15:30:40.748 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 91/138 2026-03-09T15:30:40.750 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 92/138 2026-03-09T15:30:41.409 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 117/138 2026-03-09T15:30:41.436 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 117/138 2026-03-09T15:30:41.436 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:41.436 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-03-09T15:30:41.436 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-03-09T15:30:41.436 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-03-09T15:30:41.436 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:41.498 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 118/138 2026-03-09T15:30:41.502 INFO:teuthology.orchestra.run.vm04.stdout: Installing : cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 118/138 2026-03-09T15:30:41.508 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el 119/138 2026-03-09T15:30:41.531 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.e 120/138 2026-03-09T15:30:41.535 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 121/138 2026-03-09T15:30:41.923 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T15:30:41.928 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T15:30:41.949 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T15:30:41.972 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-ply-3.11-14.el9.noarch 94/138 2026-03-09T15:30:42.071 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 95/138 2026-03-09T15:30:42.101 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 121/138 2026-03-09T15:30:42.107 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 122/138 2026-03-09T15:30:42.167 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 96/138 2026-03-09T15:30:42.182 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 97/138 2026-03-09T15:30:42.214 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 98/138 2026-03-09T15:30:42.253 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 99/138 2026-03-09T15:30:42.318 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 100/138 2026-03-09T15:30:42.329 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 101/138 2026-03-09T15:30:42.335 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 102/138 2026-03-09T15:30:42.341 INFO:teuthology.orchestra.run.vm03.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 103/138 2026-03-09T15:30:42.346 INFO:teuthology.orchestra.run.vm03.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 104/138 2026-03-09T15:30:42.348 INFO:teuthology.orchestra.run.vm03.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 105/138 2026-03-09T15:30:42.368 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 105/138 2026-03-09T15:30:42.655 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 122/138 2026-03-09T15:30:42.658 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 123/138 2026-03-09T15:30:42.709 INFO:teuthology.orchestra.run.vm03.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 106/138 2026-03-09T15:30:42.715 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 107/138 2026-03-09T15:30:42.730 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 123/138 2026-03-09T15:30:42.767 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 107/138 2026-03-09T15:30:42.767 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-03-09T15:30:42.767 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-03-09T15:30:42.767 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:42.772 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 108/138 2026-03-09T15:30:42.789 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9 124/138 2026-03-09T15:30:42.791 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 125/138 2026-03-09T15:30:42.817 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 125/138 2026-03-09T15:30:42.817 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:42.817 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-03-09T15:30:42.817 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-03-09T15:30:42.817 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-03-09T15:30:42.817 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:42.832 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 126/138 2026-03-09T15:30:42.845 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 126/138 2026-03-09T15:30:43.370 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 127/138 2026-03-09T15:30:43.374 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 128/138 2026-03-09T15:30:43.399 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 128/138 2026-03-09T15:30:43.399 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:43.399 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-03-09T15:30:43.399 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-03-09T15:30:43.399 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-03-09T15:30:43.399 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:43.410 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-678.ge911bd 129/138 2026-03-09T15:30:43.432 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-678.ge911bd 129/138 2026-03-09T15:30:43.432 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:43.432 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-03-09T15:30:43.432 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:43.590 INFO:teuthology.orchestra.run.vm04.stdout: Installing : rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 130/138 2026-03-09T15:30:43.614 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 130/138 2026-03-09T15:30:43.614 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:43.614 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-03-09T15:30:43.615 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-03-09T15:30:43.615 INFO:teuthology.orchestra.run.vm04.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-03-09T15:30:43.615 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:46.242 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 131/138 2026-03-09T15:30:46.253 INFO:teuthology.orchestra.run.vm04.stdout: Installing : rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 132/138 2026-03-09T15:30:46.258 INFO:teuthology.orchestra.run.vm04.stdout: Installing : rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 133/138 2026-03-09T15:30:46.318 INFO:teuthology.orchestra.run.vm04.stdout: Installing : libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_6 134/138 2026-03-09T15:30:46.329 INFO:teuthology.orchestra.run.vm04.stdout: Installing : ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 135/138 2026-03-09T15:30:46.333 INFO:teuthology.orchestra.run.vm04.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 136/138 2026-03-09T15:30:46.333 INFO:teuthology.orchestra.run.vm04.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/138 2026-03-09T15:30:46.351 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/138 2026-03-09T15:30:46.351 INFO:teuthology.orchestra.run.vm04.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 1/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 2/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 3/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-678.ge911bd 5/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 6/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 7/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 8/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 9/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 10/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 12/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_6 13/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 14/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 15/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 16/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 17/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 18/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9 19/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x 20/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 21/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 22/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 23/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 24/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 25/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 26/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 27/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.e 28/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 29/138 2026-03-09T15:30:47.628 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 30/138 2026-03-09T15:30:47.629 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 31/138 2026-03-09T15:30:47.629 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9 32/138 2026-03-09T15:30:47.629 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 33/138 2026-03-09T15:30:47.630 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el 34/138 2026-03-09T15:30:47.630 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 35/138 2026-03-09T15:30:47.630 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 36/138 2026-03-09T15:30:47.630 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 37/138 2026-03-09T15:30:47.630 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 38/138 2026-03-09T15:30:47.630 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 39/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 40/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 41/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 42/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 43/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 44/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 45/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-ply-3.11-14.el9.noarch 46/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 47/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 48/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 49/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : unzip-6.0-59.el9.x86_64 50/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : zip-3.0-35.el9.x86_64 51/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 52/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 53/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 54/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 55/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 56/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 60/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 61/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : lua-5.4.4-4.el9.x86_64 63/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 64/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 65/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 66/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 68/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 69/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 70/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 71/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 74/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 75/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 77/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 78/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 79/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 81/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 83/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 84/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 85/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 86/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 88/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 89/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 90/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 91/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 92/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 93/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 94/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 95/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 96/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 97/138 2026-03-09T15:30:47.631 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 98/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 99/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 100/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 101/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 105/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 107/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 108/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 109/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 113/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 114/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 115/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 116/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 127/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 128/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 131/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 132/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : re2-1:20211101-20.el9.x86_64 133/138 2026-03-09T15:30:47.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 134/138 2026-03-09T15:30:47.633 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 135/138 2026-03-09T15:30:47.633 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 136/138 2026-03-09T15:30:47.633 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 137/138 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout:Upgraded: 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout:Installed: 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: ceph-immutable-object-cache-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-diskprediction-local-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:47.747 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: grpc-data-1.46.7-10.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: libarrow-9.0.0-15.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: libconfig-1.7.2-9.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: libnbd-1.20.3-4.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: liboath-2.6.12-1.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: libunwind-1.6.2-1.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: libxslt-1.1.34-12.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: lua-5.4.4-4.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: luarocks-3.9.2-5.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: mailcap-2.1.49-5.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: openblas-0.3.29-1.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: pciutils-3.7.0-7.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: protobuf-3.14.0-17.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: python3-babel-2.9.1-2.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-03-09T15:30:47.748 INFO:teuthology.orchestra.run.vm04.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-mako-1.1.4-6.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-packaging-20.9-5.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-ply-3.11-14.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-portend-3.1.0-2.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-pycparser-2.20-6.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-requests-2.25.1-10.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-routes-2.5.1-5.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-rsa-4.9-2.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-toml-0.10.2-6.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-webob-1.8.8-2.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: qatlib-25.08.0-2.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: re2-1:20211101-20.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: socat-1.7.4.1-8.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: thrift-0.15.0-4.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: unzip-6.0-59.el9.x86_64 2026-03-09T15:30:47.749 INFO:teuthology.orchestra.run.vm04.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-03-09T15:30:47.750 INFO:teuthology.orchestra.run.vm04.stdout: zip-3.0-35.el9.x86_64 2026-03-09T15:30:47.750 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:30:47.750 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:30:47.838 DEBUG:teuthology.parallel:result is None 2026-03-09T15:30:49.456 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 108/138 2026-03-09T15:30:49.456 INFO:teuthology.orchestra.run.vm03.stdout:skipping the directory /sys 2026-03-09T15:30:49.456 INFO:teuthology.orchestra.run.vm03.stdout:skipping the directory /proc 2026-03-09T15:30:49.456 INFO:teuthology.orchestra.run.vm03.stdout:skipping the directory /mnt 2026-03-09T15:30:49.456 INFO:teuthology.orchestra.run.vm03.stdout:skipping the directory /var/tmp 2026-03-09T15:30:49.456 INFO:teuthology.orchestra.run.vm03.stdout:skipping the directory /home 2026-03-09T15:30:49.456 INFO:teuthology.orchestra.run.vm03.stdout:skipping the directory /root 2026-03-09T15:30:49.456 INFO:teuthology.orchestra.run.vm03.stdout:skipping the directory /tmp 2026-03-09T15:30:49.456 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:49.588 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 109/138 2026-03-09T15:30:49.613 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 109/138 2026-03-09T15:30:49.614 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:49.614 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-03-09T15:30:49.614 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-03-09T15:30:49.614 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-03-09T15:30:49.614 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:49.880 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 110/138 2026-03-09T15:30:49.905 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 110/138 2026-03-09T15:30:49.905 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:49.905 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-03-09T15:30:49.905 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-03-09T15:30:49.905 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-03-09T15:30:49.905 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:49.916 INFO:teuthology.orchestra.run.vm03.stdout: Installing : mailcap-2.1.49-5.el9.noarch 111/138 2026-03-09T15:30:49.920 INFO:teuthology.orchestra.run.vm03.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 112/138 2026-03-09T15:30:49.938 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T15:30:49.938 INFO:teuthology.orchestra.run.vm03.stdout:Creating group 'qat' with GID 994. 2026-03-09T15:30:49.938 INFO:teuthology.orchestra.run.vm03.stdout:Creating group 'libstoragemgmt' with GID 993. 2026-03-09T15:30:49.939 INFO:teuthology.orchestra.run.vm03.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 993 and GID 993. 2026-03-09T15:30:49.939 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:49.950 INFO:teuthology.orchestra.run.vm03.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T15:30:49.979 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T15:30:49.979 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-03-09T15:30:49.979 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:50.021 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 114/138 2026-03-09T15:30:50.097 INFO:teuthology.orchestra.run.vm03.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 115/138 2026-03-09T15:30:50.101 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 116/138 2026-03-09T15:30:50.115 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 116/138 2026-03-09T15:30:50.115 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:50.115 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-03-09T15:30:50.115 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:50.959 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 117/138 2026-03-09T15:30:50.984 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 117/138 2026-03-09T15:30:50.984 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:50.984 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-03-09T15:30:50.984 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-03-09T15:30:50.985 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-03-09T15:30:50.985 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:51.046 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 118/138 2026-03-09T15:30:51.049 INFO:teuthology.orchestra.run.vm03.stdout: Installing : cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 118/138 2026-03-09T15:30:51.056 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el 119/138 2026-03-09T15:30:51.079 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.e 120/138 2026-03-09T15:30:51.082 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 121/138 2026-03-09T15:30:51.646 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 121/138 2026-03-09T15:30:51.651 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 122/138 2026-03-09T15:30:52.210 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 122/138 2026-03-09T15:30:52.212 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 123/138 2026-03-09T15:30:52.274 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 123/138 2026-03-09T15:30:52.334 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9 124/138 2026-03-09T15:30:52.336 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 125/138 2026-03-09T15:30:52.360 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 125/138 2026-03-09T15:30:52.360 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:52.360 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-03-09T15:30:52.360 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-03-09T15:30:52.360 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-03-09T15:30:52.360 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:52.377 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 126/138 2026-03-09T15:30:52.390 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 126/138 2026-03-09T15:30:52.932 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 127/138 2026-03-09T15:30:52.936 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 128/138 2026-03-09T15:30:52.959 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 128/138 2026-03-09T15:30:52.959 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:52.959 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-03-09T15:30:52.959 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-03-09T15:30:52.959 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-03-09T15:30:52.959 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:52.971 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-678.ge911bd 129/138 2026-03-09T15:30:52.993 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-678.ge911bd 129/138 2026-03-09T15:30:52.993 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:52.993 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-03-09T15:30:52.993 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:53.157 INFO:teuthology.orchestra.run.vm03.stdout: Installing : rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 130/138 2026-03-09T15:30:53.182 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 130/138 2026-03-09T15:30:53.182 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:30:53.182 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-03-09T15:30:53.182 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-03-09T15:30:53.182 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-03-09T15:30:53.182 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:55.897 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 131/138 2026-03-09T15:30:55.908 INFO:teuthology.orchestra.run.vm03.stdout: Installing : rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 132/138 2026-03-09T15:30:55.913 INFO:teuthology.orchestra.run.vm03.stdout: Installing : rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 133/138 2026-03-09T15:30:55.971 INFO:teuthology.orchestra.run.vm03.stdout: Installing : libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_6 134/138 2026-03-09T15:30:55.980 INFO:teuthology.orchestra.run.vm03.stdout: Installing : ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 135/138 2026-03-09T15:30:55.984 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 136/138 2026-03-09T15:30:55.984 INFO:teuthology.orchestra.run.vm03.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/138 2026-03-09T15:30:56.000 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/138 2026-03-09T15:30:56.000 INFO:teuthology.orchestra.run.vm03.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 1/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 2/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 3/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-678.ge911bd 5/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 6/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 7/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 8/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 9/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 10/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 12/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_6 13/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 14/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 15/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 16/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 17/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 18/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9 19/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x 20/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 21/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 22/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 23/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 24/138 2026-03-09T15:30:57.350 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 25/138 2026-03-09T15:30:57.352 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 26/138 2026-03-09T15:30:57.352 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 27/138 2026-03-09T15:30:57.352 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.e 28/138 2026-03-09T15:30:57.352 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 29/138 2026-03-09T15:30:57.352 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 30/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 31/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9 32/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 33/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el 34/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 35/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 36/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 37/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 38/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 39/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 40/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 41/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 42/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 43/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 44/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 45/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-ply-3.11-14.el9.noarch 46/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 47/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 48/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 49/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : unzip-6.0-59.el9.x86_64 50/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : zip-3.0-35.el9.x86_64 51/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 52/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 53/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 54/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 55/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 56/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 60/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 61/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : lua-5.4.4-4.el9.x86_64 63/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 64/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 65/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 66/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 68/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 69/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 70/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 71/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/138 2026-03-09T15:30:57.353 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 74/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 75/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 77/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 78/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 79/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 81/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 83/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 84/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 85/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 86/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 88/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 89/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 90/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 91/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 92/138 2026-03-09T15:30:57.354 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 93/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 94/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 95/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 96/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 97/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 98/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 99/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 100/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 101/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 105/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 107/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 108/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 109/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 113/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 114/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 115/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 116/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/138 2026-03-09T15:30:57.355 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 127/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 128/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 131/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 132/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : re2-1:20211101-20.el9.x86_64 133/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 134/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 135/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 136/138 2026-03-09T15:30:57.356 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 137/138 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout:Upgraded: 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout:Installed: 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-immutable-object-cache-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-diskprediction-local-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: grpc-data-1.46.7-10.el9.noarch 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-03-09T15:30:57.502 INFO:teuthology.orchestra.run.vm03.stdout: libarrow-9.0.0-15.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: libconfig-1.7.2-9.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: libnbd-1.20.3-4.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: liboath-2.6.12-1.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: libunwind-1.6.2-1.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: libxslt-1.1.34-12.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: lua-5.4.4-4.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: luarocks-3.9.2-5.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: mailcap-2.1.49-5.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: openblas-0.3.29-1.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: pciutils-3.7.0-7.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: protobuf-3.14.0-17.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-babel-2.9.1-2.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-mako-1.1.4-6.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-03-09T15:30:57.503 INFO:teuthology.orchestra.run.vm03.stdout: python3-packaging-20.9-5.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-ply-3.11-14.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-portend-3.1.0-2.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-pycparser-2.20-6.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-requests-2.25.1-10.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-routes-2.5.1-5.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-rsa-4.9-2.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-toml-0.10.2-6.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-webob-1.8.8-2.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: qatlib-25.08.0-2.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: re2-1:20211101-20.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: socat-1.7.4.1-8.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: thrift-0.15.0-4.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: unzip-6.0-59.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: zip-3.0-35.el9.x86_64 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:30:57.504 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:30:57.596 DEBUG:teuthology.parallel:result is None 2026-03-09T15:30:57.596 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T15:30:58.214 DEBUG:teuthology.orchestra.run.vm03:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-03-09T15:30:58.236 INFO:teuthology.orchestra.run.vm03.stdout:19.2.3-678.ge911bdeb.el9 2026-03-09T15:30:58.236 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-678.ge911bdeb.el9 2026-03-09T15:30:58.236 INFO:teuthology.task.install:The correct ceph version 19.2.3-678.ge911bdeb is installed. 2026-03-09T15:30:58.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T15:30:58.902 DEBUG:teuthology.orchestra.run.vm04:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-03-09T15:30:58.921 INFO:teuthology.orchestra.run.vm04.stdout:19.2.3-678.ge911bdeb.el9 2026-03-09T15:30:58.921 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-678.ge911bdeb.el9 2026-03-09T15:30:58.921 INFO:teuthology.task.install:The correct ceph version 19.2.3-678.ge911bdeb is installed. 2026-03-09T15:30:58.922 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-03-09T15:30:58.922 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T15:30:58.922 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-03-09T15:30:58.951 DEBUG:teuthology.orchestra.run.vm04:> set -ex 2026-03-09T15:30:58.951 DEBUG:teuthology.orchestra.run.vm04:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-03-09T15:30:58.988 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-03-09T15:30:58.988 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T15:30:58.988 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/usr/bin/daemon-helper 2026-03-09T15:30:59.017 DEBUG:teuthology.orchestra.run.vm03:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-03-09T15:30:59.084 DEBUG:teuthology.orchestra.run.vm04:> set -ex 2026-03-09T15:30:59.084 DEBUG:teuthology.orchestra.run.vm04:> sudo dd of=/usr/bin/daemon-helper 2026-03-09T15:30:59.108 DEBUG:teuthology.orchestra.run.vm04:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-03-09T15:30:59.175 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-03-09T15:30:59.175 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T15:30:59.175 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/usr/bin/adjust-ulimits 2026-03-09T15:30:59.202 DEBUG:teuthology.orchestra.run.vm03:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-03-09T15:30:59.264 DEBUG:teuthology.orchestra.run.vm04:> set -ex 2026-03-09T15:30:59.264 DEBUG:teuthology.orchestra.run.vm04:> sudo dd of=/usr/bin/adjust-ulimits 2026-03-09T15:30:59.294 DEBUG:teuthology.orchestra.run.vm04:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-03-09T15:30:59.361 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-03-09T15:30:59.361 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T15:30:59.361 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/usr/bin/stdin-killer 2026-03-09T15:30:59.383 DEBUG:teuthology.orchestra.run.vm03:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-03-09T15:30:59.446 DEBUG:teuthology.orchestra.run.vm04:> set -ex 2026-03-09T15:30:59.446 DEBUG:teuthology.orchestra.run.vm04:> sudo dd of=/usr/bin/stdin-killer 2026-03-09T15:30:59.470 DEBUG:teuthology.orchestra.run.vm04:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-03-09T15:30:59.535 INFO:teuthology.run_tasks:Running task cephadm... 2026-03-09T15:30:59.584 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': True}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd mclock iops capacity threshold hdd': 49000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-only-match': ['CEPHADM_'], 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df', 'use-ca-signed-key': True} 2026-03-09T15:30:59.584 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T15:30:59.584 INFO:tasks.cephadm:Cluster fsid is f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:30:59.584 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-03-09T15:30:59.584 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '192.168.123.103', 'mon.b': '192.168.123.104'} 2026-03-09T15:30:59.584 INFO:tasks.cephadm:First mon is mon.a on vm03 2026-03-09T15:30:59.584 INFO:tasks.cephadm:First mgr is a 2026-03-09T15:30:59.584 INFO:tasks.cephadm:Normalizing hostnames... 2026-03-09T15:30:59.584 DEBUG:teuthology.orchestra.run.vm03:> sudo hostname $(hostname -s) 2026-03-09T15:30:59.610 DEBUG:teuthology.orchestra.run.vm04:> sudo hostname $(hostname -s) 2026-03-09T15:30:59.635 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-03-09T15:30:59.635 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T15:31:00.208 INFO:tasks.cephadm:builder_project result: [{'url': 'https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/', 'ref': 'squid', 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-25 18:55:15.146628', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '19.2.3-678-ge911bdeb', 'package_manager_version': '19.2.3-678.ge911bdeb', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3275/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-03-09T15:31:00.784 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 e911bdebe5c8faa3800735d1568fcdca65db60df from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T15:31:00.785 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/x86_64/flavors/default/cephadm 2026-03-09T15:31:00.785 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/x86_64/flavors/default/cephadm 2026-03-09T15:31:00.785 DEBUG:teuthology.orchestra.run.vm03:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-03-09T15:31:02.850 INFO:teuthology.orchestra.run.vm03.stdout:-rw-r--r--. 1 ubuntu ubuntu 788355 Mar 9 15:31 /home/ubuntu/cephtest/cephadm 2026-03-09T15:31:02.850 DEBUG:teuthology.orchestra.run.vm04:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-03-09T15:31:04.751 INFO:teuthology.orchestra.run.vm04.stdout:-rw-r--r--. 1 ubuntu ubuntu 788355 Mar 9 15:31 /home/ubuntu/cephtest/cephadm 2026-03-09T15:31:04.751 DEBUG:teuthology.orchestra.run.vm03:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-03-09T15:31:04.767 DEBUG:teuthology.orchestra.run.vm04:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-03-09T15:31:04.787 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df on all hosts... 2026-03-09T15:31:04.788 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df pull 2026-03-09T15:31:04.809 DEBUG:teuthology.orchestra.run.vm04:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df pull 2026-03-09T15:31:04.974 INFO:teuthology.orchestra.run.vm03.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T15:31:04.990 INFO:teuthology.orchestra.run.vm04.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T15:32:22.960 INFO:teuthology.orchestra.run.vm03.stdout:{ 2026-03-09T15:32:22.960 INFO:teuthology.orchestra.run.vm03.stdout: "ceph_version": "ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable)", 2026-03-09T15:32:22.960 INFO:teuthology.orchestra.run.vm03.stdout: "image_id": "654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c", 2026-03-09T15:32:22.960 INFO:teuthology.orchestra.run.vm03.stdout: "repo_digests": [ 2026-03-09T15:32:22.960 INFO:teuthology.orchestra.run.vm03.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc" 2026-03-09T15:32:22.960 INFO:teuthology.orchestra.run.vm03.stdout: ] 2026-03-09T15:32:22.960 INFO:teuthology.orchestra.run.vm03.stdout:} 2026-03-09T15:32:23.126 INFO:teuthology.orchestra.run.vm04.stdout:{ 2026-03-09T15:32:23.126 INFO:teuthology.orchestra.run.vm04.stdout: "ceph_version": "ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable)", 2026-03-09T15:32:23.126 INFO:teuthology.orchestra.run.vm04.stdout: "image_id": "654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c", 2026-03-09T15:32:23.126 INFO:teuthology.orchestra.run.vm04.stdout: "repo_digests": [ 2026-03-09T15:32:23.126 INFO:teuthology.orchestra.run.vm04.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc" 2026-03-09T15:32:23.126 INFO:teuthology.orchestra.run.vm04.stdout: ] 2026-03-09T15:32:23.126 INFO:teuthology.orchestra.run.vm04.stdout:} 2026-03-09T15:32:23.142 DEBUG:teuthology.orchestra.run.vm03:> sudo ssh-keygen -t rsa -f /root/ca-key -N '' 2026-03-09T15:32:23.306 INFO:teuthology.orchestra.run.vm03.stdout:Generating public/private rsa key pair. 2026-03-09T15:32:23.306 INFO:teuthology.orchestra.run.vm03.stdout:Your identification has been saved in /root/ca-key 2026-03-09T15:32:23.306 INFO:teuthology.orchestra.run.vm03.stdout:Your public key has been saved in /root/ca-key.pub 2026-03-09T15:32:23.306 INFO:teuthology.orchestra.run.vm03.stdout:The key fingerprint is: 2026-03-09T15:32:23.306 INFO:teuthology.orchestra.run.vm03.stdout:SHA256:K6AsT3F/UqZsN/kKcT+oWFa/TWE9stUhIH+MWu5d4WE root@vm03 2026-03-09T15:32:23.306 INFO:teuthology.orchestra.run.vm03.stdout:The key's randomart image is: 2026-03-09T15:32:23.306 INFO:teuthology.orchestra.run.vm03.stdout:+---[RSA 3072]----+ 2026-03-09T15:32:23.306 INFO:teuthology.orchestra.run.vm03.stdout:| . . | 2026-03-09T15:32:23.306 INFO:teuthology.orchestra.run.vm03.stdout:| o + | 2026-03-09T15:32:23.306 INFO:teuthology.orchestra.run.vm03.stdout:| + + E | 2026-03-09T15:32:23.307 INFO:teuthology.orchestra.run.vm03.stdout:| + ..+.+| 2026-03-09T15:32:23.307 INFO:teuthology.orchestra.run.vm03.stdout:| . o . S. .+ +o.| 2026-03-09T15:32:23.307 INFO:teuthology.orchestra.run.vm03.stdout:| . + + B *...=.. | 2026-03-09T15:32:23.307 INFO:teuthology.orchestra.run.vm03.stdout:|. + @ B +.o. | 2026-03-09T15:32:23.307 INFO:teuthology.orchestra.run.vm03.stdout:| + = B o = | 2026-03-09T15:32:23.307 INFO:teuthology.orchestra.run.vm03.stdout:| . . . ..o . | 2026-03-09T15:32:23.307 INFO:teuthology.orchestra.run.vm03.stdout:+----[SHA256]-----+ 2026-03-09T15:32:23.308 DEBUG:teuthology.orchestra.run.vm03:> sudo cat /root/ca-key.pub 2026-03-09T15:32:23.335 INFO:teuthology.orchestra.run.vm03.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnZ4mTG9QY9rTknuFWMqS9eruFokHC4CUltH0VaWgG+fPRKlFGtaAQKhqAu2Rqb6O/CfWC5gWMEgJZS3YquZLhUDRZgsvbeul02u5kTiyFS6EwSPzFBCmHuwwnOFJqOeBdEDmWacm+s3KnAbYy93OoyKxVEtz7j1DiOek+MUDTVuPjwvksFzvjH/e7sRQSHKt+dtriqhHsBfC+ytogazpnRHOFkW70CGZRkp4VqpszAvwl6KpfH99Mk0TDgrD3GKUG3rFhxrFNsqls4QemHHhSRk0G4ws/u1ISLWe7S1BU/w3ZKjG1fTCpC8KWRHHfE7UlfIPyDJ1LR7FYrnlw7pUvcJv31fRVftAuKg+Now8SMGC5gjUrubmS3PCmbB6IF3sDjOAUIa6wGpRm8DI2PZ3qUVput9zLwdADBP781Vj3Y/HDy0RytXqEQsKmjuWLHwYuVYcdMXHb8BoIEjnNhIJYpjavUyE+1/hZ66gdwGQs4pW3GXXIHNlT2Pek1jzguA8= root@vm03 2026-03-09T15:32:23.336 DEBUG:teuthology.orchestra.run.vm03:> sudo echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnZ4mTG9QY9rTknuFWMqS9eruFokHC4CUltH0VaWgG+fPRKlFGtaAQKhqAu2Rqb6O/CfWC5gWMEgJZS3YquZLhUDRZgsvbeul02u5kTiyFS6EwSPzFBCmHuwwnOFJqOeBdEDmWacm+s3KnAbYy93OoyKxVEtz7j1DiOek+MUDTVuPjwvksFzvjH/e7sRQSHKt+dtriqhHsBfC+ytogazpnRHOFkW70CGZRkp4VqpszAvwl6KpfH99Mk0TDgrD3GKUG3rFhxrFNsqls4QemHHhSRk0G4ws/u1ISLWe7S1BU/w3ZKjG1fTCpC8KWRHHfE7UlfIPyDJ1LR7FYrnlw7pUvcJv31fRVftAuKg+Now8SMGC5gjUrubmS3PCmbB6IF3sDjOAUIa6wGpRm8DI2PZ3qUVput9zLwdADBP781Vj3Y/HDy0RytXqEQsKmjuWLHwYuVYcdMXHb8BoIEjnNhIJYpjavUyE+1/hZ66gdwGQs4pW3GXXIHNlT2Pek1jzguA8= root@vm03 2026-03-09T15:32:23.336 DEBUG:teuthology.orchestra.run.vm03:> ' | sudo tee -a /etc/ssh/ca-key.pub 2026-03-09T15:32:23.408 INFO:teuthology.orchestra.run.vm03.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnZ4mTG9QY9rTknuFWMqS9eruFokHC4CUltH0VaWgG+fPRKlFGtaAQKhqAu2Rqb6O/CfWC5gWMEgJZS3YquZLhUDRZgsvbeul02u5kTiyFS6EwSPzFBCmHuwwnOFJqOeBdEDmWacm+s3KnAbYy93OoyKxVEtz7j1DiOek+MUDTVuPjwvksFzvjH/e7sRQSHKt+dtriqhHsBfC+ytogazpnRHOFkW70CGZRkp4VqpszAvwl6KpfH99Mk0TDgrD3GKUG3rFhxrFNsqls4QemHHhSRk0G4ws/u1ISLWe7S1BU/w3ZKjG1fTCpC8KWRHHfE7UlfIPyDJ1LR7FYrnlw7pUvcJv31fRVftAuKg+Now8SMGC5gjUrubmS3PCmbB6IF3sDjOAUIa6wGpRm8DI2PZ3qUVput9zLwdADBP781Vj3Y/HDy0RytXqEQsKmjuWLHwYuVYcdMXHb8BoIEjnNhIJYpjavUyE+1/hZ66gdwGQs4pW3GXXIHNlT2Pek1jzguA8= root@vm03 2026-03-09T15:32:23.408 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:32:23.410 DEBUG:teuthology.orchestra.run.vm03:> sudo echo 'TrustedUserCAKeys /etc/ssh/ca-key.pub' | sudo tee -a /etc/ssh/sshd_config && sudo systemctl restart sshd 2026-03-09T15:32:23.480 INFO:teuthology.orchestra.run.vm03.stdout:TrustedUserCAKeys /etc/ssh/ca-key.pub 2026-03-09T15:32:23.513 DEBUG:teuthology.orchestra.run.vm04:> sudo echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnZ4mTG9QY9rTknuFWMqS9eruFokHC4CUltH0VaWgG+fPRKlFGtaAQKhqAu2Rqb6O/CfWC5gWMEgJZS3YquZLhUDRZgsvbeul02u5kTiyFS6EwSPzFBCmHuwwnOFJqOeBdEDmWacm+s3KnAbYy93OoyKxVEtz7j1DiOek+MUDTVuPjwvksFzvjH/e7sRQSHKt+dtriqhHsBfC+ytogazpnRHOFkW70CGZRkp4VqpszAvwl6KpfH99Mk0TDgrD3GKUG3rFhxrFNsqls4QemHHhSRk0G4ws/u1ISLWe7S1BU/w3ZKjG1fTCpC8KWRHHfE7UlfIPyDJ1LR7FYrnlw7pUvcJv31fRVftAuKg+Now8SMGC5gjUrubmS3PCmbB6IF3sDjOAUIa6wGpRm8DI2PZ3qUVput9zLwdADBP781Vj3Y/HDy0RytXqEQsKmjuWLHwYuVYcdMXHb8BoIEjnNhIJYpjavUyE+1/hZ66gdwGQs4pW3GXXIHNlT2Pek1jzguA8= root@vm03 2026-03-09T15:32:23.513 DEBUG:teuthology.orchestra.run.vm04:> ' | sudo tee -a /etc/ssh/ca-key.pub 2026-03-09T15:32:23.541 INFO:teuthology.orchestra.run.vm04.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnZ4mTG9QY9rTknuFWMqS9eruFokHC4CUltH0VaWgG+fPRKlFGtaAQKhqAu2Rqb6O/CfWC5gWMEgJZS3YquZLhUDRZgsvbeul02u5kTiyFS6EwSPzFBCmHuwwnOFJqOeBdEDmWacm+s3KnAbYy93OoyKxVEtz7j1DiOek+MUDTVuPjwvksFzvjH/e7sRQSHKt+dtriqhHsBfC+ytogazpnRHOFkW70CGZRkp4VqpszAvwl6KpfH99Mk0TDgrD3GKUG3rFhxrFNsqls4QemHHhSRk0G4ws/u1ISLWe7S1BU/w3ZKjG1fTCpC8KWRHHfE7UlfIPyDJ1LR7FYrnlw7pUvcJv31fRVftAuKg+Now8SMGC5gjUrubmS3PCmbB6IF3sDjOAUIa6wGpRm8DI2PZ3qUVput9zLwdADBP781Vj3Y/HDy0RytXqEQsKmjuWLHwYuVYcdMXHb8BoIEjnNhIJYpjavUyE+1/hZ66gdwGQs4pW3GXXIHNlT2Pek1jzguA8= root@vm03 2026-03-09T15:32:23.541 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:32:23.543 DEBUG:teuthology.orchestra.run.vm04:> sudo echo 'TrustedUserCAKeys /etc/ssh/ca-key.pub' | sudo tee -a /etc/ssh/sshd_config && sudo systemctl restart sshd 2026-03-09T15:32:23.611 INFO:teuthology.orchestra.run.vm04.stdout:TrustedUserCAKeys /etc/ssh/ca-key.pub 2026-03-09T15:32:23.643 DEBUG:teuthology.orchestra.run.vm03:> sudo ssh-keygen -t rsa -f /root/cephadm-ssh-key -N '' && sudo ssh-keygen -s /root/ca-key -I user_root -n root -V +52w /root/cephadm-ssh-key 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:Generating public/private rsa key pair. 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:Your identification has been saved in /root/cephadm-ssh-key 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:Your public key has been saved in /root/cephadm-ssh-key.pub 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:The key fingerprint is: 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:SHA256:HhqSJqgMK8GpCBmkjLuSTDIHMBLCYZamUgHhK9QR0SY root@vm03 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:The key's randomart image is: 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:+---[RSA 3072]----+ 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:|XO+=+ | 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:|%=oE.o | 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:|B= .o | 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:|=*o . | 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:|%=o + . S | 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:|%B o . + . | 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:|Xo . . | 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:|o | 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:| | 2026-03-09T15:32:23.801 INFO:teuthology.orchestra.run.vm03.stdout:+----[SHA256]-----+ 2026-03-09T15:32:23.816 INFO:teuthology.orchestra.run.vm03.stderr:Signed user key /root/cephadm-ssh-key-cert.pub: id "user_root" serial 0 for root valid from 2026-03-09T15:31:00 to 2027-03-08T15:32:23 2026-03-09T15:32:23.818 DEBUG:teuthology.orchestra.run.vm03:> sudo cat /etc/ssh/ca-key.pub 2026-03-09T15:32:23.842 INFO:teuthology.orchestra.run.vm03.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnZ4mTG9QY9rTknuFWMqS9eruFokHC4CUltH0VaWgG+fPRKlFGtaAQKhqAu2Rqb6O/CfWC5gWMEgJZS3YquZLhUDRZgsvbeul02u5kTiyFS6EwSPzFBCmHuwwnOFJqOeBdEDmWacm+s3KnAbYy93OoyKxVEtz7j1DiOek+MUDTVuPjwvksFzvjH/e7sRQSHKt+dtriqhHsBfC+ytogazpnRHOFkW70CGZRkp4VqpszAvwl6KpfH99Mk0TDgrD3GKUG3rFhxrFNsqls4QemHHhSRk0G4ws/u1ISLWe7S1BU/w3ZKjG1fTCpC8KWRHHfE7UlfIPyDJ1LR7FYrnlw7pUvcJv31fRVftAuKg+Now8SMGC5gjUrubmS3PCmbB6IF3sDjOAUIa6wGpRm8DI2PZ3qUVput9zLwdADBP781Vj3Y/HDy0RytXqEQsKmjuWLHwYuVYcdMXHb8BoIEjnNhIJYpjavUyE+1/hZ66gdwGQs4pW3GXXIHNlT2Pek1jzguA8= root@vm03 2026-03-09T15:32:23.842 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:32:23.844 DEBUG:teuthology.orchestra.run.vm03:> sudo cat /etc/ssh/sshd_config | grep TrustedUserCAKeys 2026-03-09T15:32:23.910 INFO:teuthology.orchestra.run.vm03.stdout:TrustedUserCAKeys /etc/ssh/ca-key.pub 2026-03-09T15:32:23.910 DEBUG:teuthology.orchestra.run.vm04:> sudo cat /etc/ssh/ca-key.pub 2026-03-09T15:32:23.935 INFO:teuthology.orchestra.run.vm04.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnZ4mTG9QY9rTknuFWMqS9eruFokHC4CUltH0VaWgG+fPRKlFGtaAQKhqAu2Rqb6O/CfWC5gWMEgJZS3YquZLhUDRZgsvbeul02u5kTiyFS6EwSPzFBCmHuwwnOFJqOeBdEDmWacm+s3KnAbYy93OoyKxVEtz7j1DiOek+MUDTVuPjwvksFzvjH/e7sRQSHKt+dtriqhHsBfC+ytogazpnRHOFkW70CGZRkp4VqpszAvwl6KpfH99Mk0TDgrD3GKUG3rFhxrFNsqls4QemHHhSRk0G4ws/u1ISLWe7S1BU/w3ZKjG1fTCpC8KWRHHfE7UlfIPyDJ1LR7FYrnlw7pUvcJv31fRVftAuKg+Now8SMGC5gjUrubmS3PCmbB6IF3sDjOAUIa6wGpRm8DI2PZ3qUVput9zLwdADBP781Vj3Y/HDy0RytXqEQsKmjuWLHwYuVYcdMXHb8BoIEjnNhIJYpjavUyE+1/hZ66gdwGQs4pW3GXXIHNlT2Pek1jzguA8= root@vm03 2026-03-09T15:32:23.935 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:32:23.936 DEBUG:teuthology.orchestra.run.vm04:> sudo cat /etc/ssh/sshd_config | grep TrustedUserCAKeys 2026-03-09T15:32:24.005 INFO:teuthology.orchestra.run.vm04.stdout:TrustedUserCAKeys /etc/ssh/ca-key.pub 2026-03-09T15:32:24.006 DEBUG:teuthology.orchestra.run.vm03:> sudo ls /root/ 2026-03-09T15:32:24.033 INFO:teuthology.orchestra.run.vm03.stdout:ca-key 2026-03-09T15:32:24.033 INFO:teuthology.orchestra.run.vm03.stdout:ca-key.pub 2026-03-09T15:32:24.033 INFO:teuthology.orchestra.run.vm03.stdout:cephadm-ssh-key 2026-03-09T15:32:24.033 INFO:teuthology.orchestra.run.vm03.stdout:cephadm-ssh-key-cert.pub 2026-03-09T15:32:24.033 INFO:teuthology.orchestra.run.vm03.stdout:cephadm-ssh-key.pub 2026-03-09T15:32:24.033 INFO:teuthology.orchestra.run.vm03.stdout:original-ks.cfg 2026-03-09T15:32:24.034 DEBUG:teuthology.orchestra.run.vm03:> sudo mkdir -p /etc/ceph 2026-03-09T15:32:24.102 DEBUG:teuthology.orchestra.run.vm04:> sudo mkdir -p /etc/ceph 2026-03-09T15:32:24.133 DEBUG:teuthology.orchestra.run.vm03:> sudo chmod 777 /etc/ceph 2026-03-09T15:32:24.174 DEBUG:teuthology.orchestra.run.vm04:> sudo chmod 777 /etc/ceph 2026-03-09T15:32:24.203 INFO:tasks.cephadm:Writing seed config... 2026-03-09T15:32:24.204 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2026-03-09T15:32:24.204 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-03-09T15:32:24.204 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-03-09T15:32:24.204 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = True 2026-03-09T15:32:24.204 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-03-09T15:32:24.204 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-03-09T15:32:24.204 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-03-09T15:32:24.204 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-03-09T15:32:24.204 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-03-09T15:32:24.204 INFO:tasks.cephadm: override: [osd] osd mclock iops capacity threshold hdd = 49000 2026-03-09T15:32:24.204 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T15:32:24.204 DEBUG:teuthology.orchestra.run.vm03:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-03-09T15:32:24.231 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f9592f66-1bcc-11f1-9993-3b6a3d16e741 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd mclock iops capacity threshold hdd = 49000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = True [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2026-03-09T15:32:24.232 DEBUG:teuthology.orchestra.run.vm03:mon.a> sudo journalctl -f -n 0 -u ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mon.a.service 2026-03-09T15:32:24.274 DEBUG:teuthology.orchestra.run.vm03:mgr.a> sudo journalctl -f -n 0 -u ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mgr.a.service 2026-03-09T15:32:24.316 INFO:tasks.cephadm:Bootstrapping... 2026-03-09T15:32:24.316 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df -v bootstrap --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --ssh-private-key /root/cephadm-ssh-key --ssh-signed-cert /root/cephadm-ssh-key-cert.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 192.168.123.103 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-03-09T15:32:24.467 INFO:teuthology.orchestra.run.vm03.stdout:-------------------------------------------------------------------------------- 2026-03-09T15:32:24.468 INFO:teuthology.orchestra.run.vm03.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df', '-v', 'bootstrap', '--fsid', 'f9592f66-1bcc-11f1-9993-3b6a3d16e741', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--ssh-private-key', '/root/cephadm-ssh-key', '--ssh-signed-cert', '/root/cephadm-ssh-key-cert.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '192.168.123.103', '--skip-admin-label'] 2026-03-09T15:32:24.468 INFO:teuthology.orchestra.run.vm03.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-03-09T15:32:24.468 INFO:teuthology.orchestra.run.vm03.stdout:Verifying podman|docker is present... 2026-03-09T15:32:24.491 INFO:teuthology.orchestra.run.vm03.stdout:/bin/podman: stdout 5.8.0 2026-03-09T15:32:24.491 INFO:teuthology.orchestra.run.vm03.stdout:Verifying lvm2 is present... 2026-03-09T15:32:24.492 INFO:teuthology.orchestra.run.vm03.stdout:Verifying time synchronization is in place... 2026-03-09T15:32:24.501 INFO:teuthology.orchestra.run.vm03.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-03-09T15:32:24.501 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-03-09T15:32:24.508 INFO:teuthology.orchestra.run.vm03.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-03-09T15:32:24.508 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stdout inactive 2026-03-09T15:32:24.514 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stdout enabled 2026-03-09T15:32:24.520 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stdout active 2026-03-09T15:32:24.520 INFO:teuthology.orchestra.run.vm03.stdout:Unit chronyd.service is enabled and running 2026-03-09T15:32:24.520 INFO:teuthology.orchestra.run.vm03.stdout:Repeating the final host check... 2026-03-09T15:32:24.542 INFO:teuthology.orchestra.run.vm03.stdout:/bin/podman: stdout 5.8.0 2026-03-09T15:32:24.542 INFO:teuthology.orchestra.run.vm03.stdout:podman (/bin/podman) version 5.8.0 is present 2026-03-09T15:32:24.542 INFO:teuthology.orchestra.run.vm03.stdout:systemctl is present 2026-03-09T15:32:24.542 INFO:teuthology.orchestra.run.vm03.stdout:lvcreate is present 2026-03-09T15:32:24.549 INFO:teuthology.orchestra.run.vm03.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-03-09T15:32:24.549 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-03-09T15:32:24.555 INFO:teuthology.orchestra.run.vm03.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-03-09T15:32:24.555 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stdout inactive 2026-03-09T15:32:24.562 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stdout enabled 2026-03-09T15:32:24.569 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stdout active 2026-03-09T15:32:24.569 INFO:teuthology.orchestra.run.vm03.stdout:Unit chronyd.service is enabled and running 2026-03-09T15:32:24.569 INFO:teuthology.orchestra.run.vm03.stdout:Host looks OK 2026-03-09T15:32:24.569 INFO:teuthology.orchestra.run.vm03.stdout:Cluster fsid: f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:32:24.569 INFO:teuthology.orchestra.run.vm03.stdout:Acquiring lock 139822356721280 on /run/cephadm/f9592f66-1bcc-11f1-9993-3b6a3d16e741.lock 2026-03-09T15:32:24.569 INFO:teuthology.orchestra.run.vm03.stdout:Lock 139822356721280 acquired on /run/cephadm/f9592f66-1bcc-11f1-9993-3b6a3d16e741.lock 2026-03-09T15:32:24.569 INFO:teuthology.orchestra.run.vm03.stdout:Verifying IP 192.168.123.103 port 3300 ... 2026-03-09T15:32:24.570 INFO:teuthology.orchestra.run.vm03.stdout:Verifying IP 192.168.123.103 port 6789 ... 2026-03-09T15:32:24.570 INFO:teuthology.orchestra.run.vm03.stdout:Base mon IP(s) is [192.168.123.103:3300, 192.168.123.103:6789], mon addrv is [v2:192.168.123.103:3300,v1:192.168.123.103:6789] 2026-03-09T15:32:24.574 INFO:teuthology.orchestra.run.vm03.stdout:/sbin/ip: stdout default via 192.168.123.1 dev eth0 proto dhcp src 192.168.123.103 metric 100 2026-03-09T15:32:24.574 INFO:teuthology.orchestra.run.vm03.stdout:/sbin/ip: stdout 192.168.123.0/24 dev eth0 proto kernel scope link src 192.168.123.103 metric 100 2026-03-09T15:32:24.578 INFO:teuthology.orchestra.run.vm03.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-03-09T15:32:24.578 INFO:teuthology.orchestra.run.vm03.stdout:/sbin/ip: stdout fe80::/64 dev eth0 proto kernel metric 1024 pref medium 2026-03-09T15:32:24.582 INFO:teuthology.orchestra.run.vm03.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-03-09T15:32:24.582 INFO:teuthology.orchestra.run.vm03.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-03-09T15:32:24.582 INFO:teuthology.orchestra.run.vm03.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-03-09T15:32:24.582 INFO:teuthology.orchestra.run.vm03.stdout:/sbin/ip: stdout 2: eth0: mtu 1500 state UP qlen 1000 2026-03-09T15:32:24.582 INFO:teuthology.orchestra.run.vm03.stdout:/sbin/ip: stdout inet6 fe80::5055:ff:fe00:3/64 scope link noprefixroute 2026-03-09T15:32:24.582 INFO:teuthology.orchestra.run.vm03.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-03-09T15:32:24.583 INFO:teuthology.orchestra.run.vm03.stdout:Mon IP `192.168.123.103` is in CIDR network `192.168.123.0/24` 2026-03-09T15:32:24.583 INFO:teuthology.orchestra.run.vm03.stdout:Mon IP `192.168.123.103` is in CIDR network `192.168.123.0/24` 2026-03-09T15:32:24.583 INFO:teuthology.orchestra.run.vm03.stdout:Inferred mon public CIDR from local network configuration ['192.168.123.0/24', '192.168.123.0/24'] 2026-03-09T15:32:24.583 INFO:teuthology.orchestra.run.vm03.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-03-09T15:32:24.584 INFO:teuthology.orchestra.run.vm03.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T15:32:25.796 INFO:teuthology.orchestra.run.vm03.stdout:/bin/podman: stdout 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c 2026-03-09T15:32:25.797 INFO:teuthology.orchestra.run.vm03.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T15:32:25.797 INFO:teuthology.orchestra.run.vm03.stdout:/bin/podman: stderr Getting image source signatures 2026-03-09T15:32:25.797 INFO:teuthology.orchestra.run.vm03.stdout:/bin/podman: stderr Copying blob sha256:1752b8d01aa0dd33bbe0ab24e8316174c94fbdcd5d26252e2680bba0624747a7 2026-03-09T15:32:25.797 INFO:teuthology.orchestra.run.vm03.stdout:/bin/podman: stderr Copying blob sha256:8e380faede39ebd4286247457b408d979ab568aafd8389c42ec304b8cfba4e92 2026-03-09T15:32:25.797 INFO:teuthology.orchestra.run.vm03.stdout:/bin/podman: stderr Copying config sha256:654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c 2026-03-09T15:32:25.797 INFO:teuthology.orchestra.run.vm03.stdout:/bin/podman: stderr Writing manifest to image destination 2026-03-09T15:32:25.985 INFO:teuthology.orchestra.run.vm03.stdout:ceph: stdout ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable) 2026-03-09T15:32:25.985 INFO:teuthology.orchestra.run.vm03.stdout:Ceph version: ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable) 2026-03-09T15:32:25.985 INFO:teuthology.orchestra.run.vm03.stdout:Extracting ceph user uid/gid from container image... 2026-03-09T15:32:26.079 INFO:teuthology.orchestra.run.vm03.stdout:stat: stdout 167 167 2026-03-09T15:32:26.079 INFO:teuthology.orchestra.run.vm03.stdout:Creating initial keys... 2026-03-09T15:32:26.192 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph-authtool: stdout AQAK6K5p6J7LCBAA3ZJ+Xs9fcb9u1pX4dtmKXQ== 2026-03-09T15:32:26.293 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph-authtool: stdout AQAK6K5pf5RUEBAAUrBBDMhidOBHtqml2yfIDw== 2026-03-09T15:32:26.393 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph-authtool: stdout AQAK6K5pJXAIFhAAjwAFtUMYm2dmY/4F+Yb69w== 2026-03-09T15:32:26.394 INFO:teuthology.orchestra.run.vm03.stdout:Creating initial monmap... 2026-03-09T15:32:26.498 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-03-09T15:32:26.498 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-03-09T15:32:26.498 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:32:26.498 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-03-09T15:32:26.498 INFO:teuthology.orchestra.run.vm03.stdout:monmaptool for a [v2:192.168.123.103:3300,v1:192.168.123.103:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-03-09T15:32:26.498 INFO:teuthology.orchestra.run.vm03.stdout:setting min_mon_release = quincy 2026-03-09T15:32:26.498 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/monmaptool: set fsid to f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:32:26.498 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-03-09T15:32:26.498 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:32:26.499 INFO:teuthology.orchestra.run.vm03.stdout:Creating mon... 2026-03-09T15:32:26.645 INFO:teuthology.orchestra.run.vm03.stdout:create mon.a on 2026-03-09T15:32:26.872 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-03-09T15:32:26.995 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-03-09T15:32:27.133 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741.target → /etc/systemd/system/ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741.target. 2026-03-09T15:32:27.133 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741.target → /etc/systemd/system/ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741.target. 2026-03-09T15:32:27.290 INFO:teuthology.orchestra.run.vm03.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mon.a 2026-03-09T15:32:27.291 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mon.a.service: Unit ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mon.a.service not loaded. 2026-03-09T15:32:27.434 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741.target.wants/ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mon.a.service → /etc/systemd/system/ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@.service. 2026-03-09T15:32:28.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:27 vm03 podman[52426]: 2026-03-09 15:32:27.598040776 +0000 UTC m=+0.011778142 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T15:32:28.196 INFO:teuthology.orchestra.run.vm03.stdout:firewalld does not appear to be present 2026-03-09T15:32:28.197 INFO:teuthology.orchestra.run.vm03.stdout:Not possible to enable service . firewalld.service is not available 2026-03-09T15:32:28.197 INFO:teuthology.orchestra.run.vm03.stdout:Waiting for mon to start... 2026-03-09T15:32:28.197 INFO:teuthology.orchestra.run.vm03.stdout:Waiting for mon... 2026-03-09T15:32:28.399 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:28 vm03 podman[52426]: 2026-03-09 15:32:28.141604765 +0000 UTC m=+0.555342130 container create 0b49d905200f66ddca07a0ca7afc2a05197f1723c23cf36fe6e2a7e88fdfe3c1 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a, org.label-schema.schema-version=1.0, CEPH_REF=squid, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2) 2026-03-09T15:32:28.399 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:28 vm03 podman[52426]: 2026-03-09 15:32:28.18526324 +0000 UTC m=+0.599000605 container init 0b49d905200f66ddca07a0ca7afc2a05197f1723c23cf36fe6e2a7e88fdfe3c1 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, OSD_FLAVOR=default, CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, ceph=True) 2026-03-09T15:32:28.399 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:28 vm03 podman[52426]: 2026-03-09 15:32:28.188064255 +0000 UTC m=+0.601801620 container start 0b49d905200f66ddca07a0ca7afc2a05197f1723c23cf36fe6e2a7e88fdfe3c1 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a, CEPH_REF=squid, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-03-09T15:32:28.399 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:28 vm03 bash[52426]: 0b49d905200f66ddca07a0ca7afc2a05197f1723c23cf36fe6e2a7e88fdfe3c1 2026-03-09T15:32:28.399 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:28 vm03 systemd[1]: Started Ceph mon.a for f9592f66-1bcc-11f1-9993-3b6a3d16e741. 2026-03-09T15:32:28.399 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:28 vm03 ceph-mon[52441]: mkfs f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:32:28.399 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:28 vm03 ceph-mon[52441]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout cluster: 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout id: f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout services: 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.172872s) 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout data: 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout pgs: 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:mon is available 2026-03-09T15:32:28.586 INFO:teuthology.orchestra.run.vm03.stdout:Assimilating anything we can from ceph.conf... 2026-03-09T15:32:29.176 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 2026-03-09T15:32:29.176 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout [global] 2026-03-09T15:32:29.176 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout fsid = f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:32:29.176 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-03-09T15:32:29.176 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mon_host = [v2:192.168.123.103:3300,v1:192.168.123.103:6789] 2026-03-09T15:32:29.176 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-03-09T15:32:29.176 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-03-09T15:32:29.176 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-03-09T15:32:29.176 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-03-09T15:32:29.176 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 2026-03-09T15:32:29.176 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout [mgr] 2026-03-09T15:32:29.176 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = True 2026-03-09T15:32:29.177 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-03-09T15:32:29.177 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 2026-03-09T15:32:29.177 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout [osd] 2026-03-09T15:32:29.177 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-03-09T15:32:29.177 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-03-09T15:32:29.177 INFO:teuthology.orchestra.run.vm03.stdout:Generating new minimal ceph.conf... 2026-03-09T15:32:29.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52441]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T15:32:29.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52441]: monmap epoch 1 2026-03-09T15:32:29.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52441]: fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:32:29.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52441]: last_changed 2026-03-09T15:32:26.478905+0000 2026-03-09T15:32:29.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52441]: created 2026-03-09T15:32:26.478905+0000 2026-03-09T15:32:29.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52441]: min_mon_release 19 (squid) 2026-03-09T15:32:29.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52441]: election_strategy: 1 2026-03-09T15:32:29.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52441]: 0: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.a 2026-03-09T15:32:29.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52441]: fsmap 2026-03-09T15:32:29.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52441]: osdmap e1: 0 total, 0 up, 0 in 2026-03-09T15:32:29.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52441]: mgrmap e1: no daemons active 2026-03-09T15:32:29.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52441]: from='client.? 192.168.123.103:0/4207432642' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2026-03-09T15:32:29.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52441]: from='client.? 192.168.123.103:0/1328568282' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-03-09T15:32:29.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52441]: from='client.? 192.168.123.103:0/1328568282' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-03-09T15:32:29.393 INFO:teuthology.orchestra.run.vm03.stdout:Restarting the monitor... 2026-03-09T15:32:29.701 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 systemd[1]: Stopping Ceph mon.a for f9592f66-1bcc-11f1-9993-3b6a3d16e741... 2026-03-09T15:32:29.701 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a[52437]: 2026-03-09T15:32:29.483+0000 7fe4839f1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T15:32:29.701 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a[52437]: 2026-03-09T15:32:29.483+0000 7fe4839f1640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-03-09T15:32:29.948 INFO:teuthology.orchestra.run.vm03.stdout:Setting public_network to 192.168.123.0/24 in mon config section 2026-03-09T15:32:29.967 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 podman[52645]: 2026-03-09 15:32:29.700305594 +0000 UTC m=+0.231855157 container died 0b49d905200f66ddca07a0ca7afc2a05197f1723c23cf36fe6e2a7e88fdfe3c1 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a, CEPH_REF=squid, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223) 2026-03-09T15:32:29.967 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 podman[52645]: 2026-03-09 15:32:29.717825053 +0000 UTC m=+0.249374615 container remove 0b49d905200f66ddca07a0ca7afc2a05197f1723c23cf36fe6e2a7e88fdfe3c1 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, ceph=True, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=squid, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3) 2026-03-09T15:32:29.968 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 bash[52645]: ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a 2026-03-09T15:32:29.968 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 systemd[1]: ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mon.a.service: Deactivated successfully. 2026-03-09T15:32:29.968 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 systemd[1]: Stopped Ceph mon.a for f9592f66-1bcc-11f1-9993-3b6a3d16e741. 2026-03-09T15:32:29.968 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 systemd[1]: Starting Ceph mon.a for f9592f66-1bcc-11f1-9993-3b6a3d16e741... 2026-03-09T15:32:29.968 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 podman[52716]: 2026-03-09 15:32:29.903543595 +0000 UTC m=+0.019873778 container create c669fc41496b115fa190dd4471bebe9a17f970b45440e80170fc1e978a679977 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a, ceph=True, CEPH_REF=squid, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-03-09T15:32:29.968 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 podman[52716]: 2026-03-09 15:32:29.93408378 +0000 UTC m=+0.050413963 container init c669fc41496b115fa190dd4471bebe9a17f970b45440e80170fc1e978a679977 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_REF=squid, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0) 2026-03-09T15:32:29.968 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 podman[52716]: 2026-03-09 15:32:29.938387968 +0000 UTC m=+0.054718151 container start c669fc41496b115fa190dd4471bebe9a17f970b45440e80170fc1e978a679977 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df) 2026-03-09T15:32:29.968 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 bash[52716]: c669fc41496b115fa190dd4471bebe9a17f970b45440e80170fc1e978a679977 2026-03-09T15:32:29.968 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 podman[52716]: 2026-03-09 15:32:29.895864287 +0000 UTC m=+0.012194470 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T15:32:29.968 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 systemd[1]: Started Ceph mon.a for f9592f66-1bcc-11f1-9993-3b6a3d16e741. 2026-03-09T15:32:29.968 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: set uid:gid to 167:167 (ceph:ceph) 2026-03-09T15:32:30.170 INFO:teuthology.orchestra.run.vm03.stdout:Wrote config to /etc/ceph/ceph.conf 2026-03-09T15:32:30.171 INFO:teuthology.orchestra.run.vm03.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-03-09T15:32:30.171 INFO:teuthology.orchestra.run.vm03.stdout:Creating mgr... 2026-03-09T15:32:30.171 INFO:teuthology.orchestra.run.vm03.stdout:Verifying port 0.0.0.0:9283 ... 2026-03-09T15:32:30.172 INFO:teuthology.orchestra.run.vm03.stdout:Verifying port 0.0.0.0:8765 ... 2026-03-09T15:32:30.257 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable), process ceph-mon, pid 2 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: pidfile_write: ignore empty --pid-file 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: load: jerasure load: lrc 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: RocksDB version: 7.9.2 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Git sha 0 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Compile date 2026-02-25 18:11:04 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: DB SUMMARY 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: DB Session ID: GVBD3P2SRBI6X62QYVN2 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: CURRENT file: CURRENT 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: IDENTITY file: IDENTITY 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 86937 ; 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.error_if_exists: 0 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.create_if_missing: 0 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.paranoid_checks: 1 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.flush_verify_memtable_count: 1 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.env: 0x56023ec84dc0 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.fs: PosixFileSystem 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.info_log: 0x560241178700 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_file_opening_threads: 16 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.statistics: (nil) 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.use_fsync: 0 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_log_file_size: 0 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.log_file_time_to_roll: 0 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.keep_log_file_num: 1000 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.recycle_log_file_num: 0 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.allow_fallocate: 1 2026-03-09T15:32:30.258 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.allow_mmap_reads: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.allow_mmap_writes: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.use_direct_reads: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.create_missing_column_families: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.db_log_dir: 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.wal_dir: 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.table_cache_numshardbits: 6 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.WAL_ttl_seconds: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.WAL_size_limit_MB: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.is_fd_close_on_exec: 1 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.advise_random_on_open: 1 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.db_write_buffer_size: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.write_buffer_manager: 0x56024117d900 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.use_adaptive_mutex: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.rate_limiter: (nil) 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.wal_recovery_mode: 2 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.enable_thread_tracking: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.enable_pipelined_write: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.unordered_write: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.row_cache: None 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.wal_filter: None 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.allow_ingest_behind: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.two_write_queues: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.manual_wal_flush: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.wal_compression: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.atomic_flush: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-03-09T15:32:30.259 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.persist_stats_to_disk: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.write_dbid_to_manifest: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.log_readahead_size: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.best_efforts_recovery: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.allow_data_in_errors: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.db_host_id: __hostname__ 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.enforce_single_del_contracts: true 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_background_jobs: 2 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_background_compactions: -1 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_subcompactions: 1 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.delayed_write_rate : 16777216 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_total_wal_size: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.stats_dump_period_sec: 600 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.stats_persist_period_sec: 600 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_open_files: -1 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.bytes_per_sync: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.wal_bytes_per_sync: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.strict_bytes_per_sync: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compaction_readahead_size: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_background_flushes: -1 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Compression algorithms supported: 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: kZSTD supported: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: kXpressCompression supported: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: kBZip2Compression supported: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: kLZ4Compression supported: 1 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: kZlibCompression supported: 1 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: kLZ4HCCompression supported: 1 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: kSnappyCompression supported: 1 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Fast CRC32 supported: Supported on x86 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: DMutex implementation: pthread_mutex_t 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-03-09T15:32:30.260 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.merge_operator: 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compaction_filter: None 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compaction_filter_factory: None 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.sst_partitioner_factory: None 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.memtable_factory: SkipListFactory 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.table_factory: BlockBasedTable 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560241178640) 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: cache_index_and_filter_blocks: 1 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: pin_top_level_index_and_filter: 1 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: index_type: 0 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: data_block_index_type: 0 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: index_shortening: 1 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: data_block_hash_table_util_ratio: 0.750000 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: checksum: 4 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: no_block_cache: 0 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: block_cache: 0x56024119d350 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: block_cache_name: BinnedLRUCache 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: block_cache_options: 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: capacity : 536870912 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: num_shard_bits : 4 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: strict_capacity_limit : 0 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: high_pri_pool_ratio: 0.000 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: block_cache_compressed: (nil) 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: persistent_cache: (nil) 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: block_size: 4096 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: block_size_deviation: 10 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: block_restart_interval: 16 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: index_block_restart_interval: 1 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: metadata_block_size: 4096 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: partition_filters: 0 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: use_delta_encoding: 1 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: filter_policy: bloomfilter 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: whole_key_filtering: 1 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: verify_compression: 0 2026-03-09T15:32:30.261 INFO:journalctl@ceph.mon.a.vm03.stdout: read_amp_bytes_per_bit: 0 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout: format_version: 5 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout: enable_index_compression: 1 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout: block_align: 0 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout: max_auto_readahead_size: 262144 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout: prepopulate_block_cache: 0 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout: initial_auto_readahead_size: 8192 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout: num_file_reads_for_auto_readahead: 2 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.write_buffer_size: 33554432 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_write_buffer_number: 2 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compression: NoCompression 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.bottommost_compression: Disabled 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.prefix_extractor: nullptr 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.num_levels: 7 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compression_opts.window_bits: -14 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compression_opts.level: 32767 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compression_opts.strategy: 0 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compression_opts.enabled: false 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-03-09T15:32:30.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.target_file_size_base: 67108864 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.target_file_size_multiplier: 1 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.arena_block_size: 1048576 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.disable_auto_compactions: 0 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.inplace_update_support: 0 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.inplace_update_num_locks: 10000 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.memtable_huge_page_size: 0 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.bloom_locality: 0 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.max_successive_merges: 0 2026-03-09T15:32:30.263 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.optimize_filters_for_hits: 0 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.paranoid_file_checks: 0 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.force_consistency_checks: 1 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.report_bg_io_stats: 0 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.ttl: 2592000 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.periodic_compaction_seconds: 0 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.enable_blob_files: false 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.min_blob_size: 0 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.blob_file_size: 268435456 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.blob_compression_type: NoCompression 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.enable_blob_garbage_collection: false 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.blob_file_starting_level: 0 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b40b2757-a22b-4856-9578-bdd43fcce492 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773070349972974, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773070349974906, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 83898, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 245, "table_properties": {"data_size": 82064, "index_size": 223, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10134, "raw_average_key_size": 47, "raw_value_size": 76259, "raw_average_value_size": 359, "num_data_blocks": 10, "num_entries": 212, "num_filter_entries": 212, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1773070349, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b40b2757-a22b-4856-9578-bdd43fcce492", "db_session_id": "GVBD3P2SRBI6X62QYVN2", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773070349974965, "job": 1, "event": "recovery_finished"} 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56024119ee00 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: rocksdb: DB pointer 0x5602412b4000 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: starting mon.a rank 0 at public addrs [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] at bind addrs [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: mon.a@-1(???) e1 preinit fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: mon.a@-1(???).mds e1 new map 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: mon.a@-1(???).mds e1 print_map 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout: e1 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout: btime 2026-03-09T15:32:28:225350+0000 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout: legacy client fscid: -1 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout: 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout: No filesystems configured 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T15:32:30.264 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T15:32:30.265 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:29 vm03 ceph-mon[52731]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-03-09T15:32:30.347 INFO:teuthology.orchestra.run.vm03.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mgr.a 2026-03-09T15:32:30.347 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mgr.a.service: Unit ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mgr.a.service not loaded. 2026-03-09T15:32:30.492 INFO:teuthology.orchestra.run.vm03.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741.target.wants/ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mgr.a.service → /etc/systemd/system/ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@.service. 2026-03-09T15:32:30.636 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:30 vm03 systemd[1]: Starting Ceph mgr.a for f9592f66-1bcc-11f1-9993-3b6a3d16e741... 2026-03-09T15:32:30.685 INFO:teuthology.orchestra.run.vm03.stdout:firewalld does not appear to be present 2026-03-09T15:32:30.685 INFO:teuthology.orchestra.run.vm03.stdout:Not possible to enable service . firewalld.service is not available 2026-03-09T15:32:30.685 INFO:teuthology.orchestra.run.vm03.stdout:firewalld does not appear to be present 2026-03-09T15:32:30.685 INFO:teuthology.orchestra.run.vm03.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-03-09T15:32:30.685 INFO:teuthology.orchestra.run.vm03.stdout:Waiting for mgr to start... 2026-03-09T15:32:30.685 INFO:teuthology.orchestra.run.vm03.stdout:Waiting for mgr... 2026-03-09T15:32:30.891 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 2026-03-09T15:32:30.891 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout { 2026-03-09T15:32:30.891 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "fsid": "f9592f66-1bcc-11f1-9993-3b6a3d16e741", 2026-03-09T15:32:30.891 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "health": { 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 0 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout ], 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "a" 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout ], 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "btime": "2026-03-09T15:32:28:225350+0000", 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "available": false, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "restful" 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout ], 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "modified": "2026-03-09T15:32:28.226097+0000", 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:30.892 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-09T15:32:30.893 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout } 2026-03-09T15:32:30.893 INFO:teuthology.orchestra.run.vm03.stdout:mgr not available, waiting (1/15)... 2026-03-09T15:32:30.904 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:30 vm03 podman[52928]: 2026-03-09 15:32:30.635366732 +0000 UTC m=+0.017856372 container create e51bdd23e9e64e04cee8b62efa0dea96ed36dd3c5555eafda011c60cbe2d4bba (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2026-03-09T15:32:30.905 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:30 vm03 podman[52928]: 2026-03-09 15:32:30.672033436 +0000 UTC m=+0.054523076 container init e51bdd23e9e64e04cee8b62efa0dea96ed36dd3c5555eafda011c60cbe2d4bba (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a, CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-03-09T15:32:30.905 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:30 vm03 podman[52928]: 2026-03-09 15:32:30.674854718 +0000 UTC m=+0.057344358 container start e51bdd23e9e64e04cee8b62efa0dea96ed36dd3c5555eafda011c60cbe2d4bba (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a, ceph=True, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-03-09T15:32:30.905 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:30 vm03 bash[52928]: e51bdd23e9e64e04cee8b62efa0dea96ed36dd3c5555eafda011c60cbe2d4bba 2026-03-09T15:32:30.905 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:30 vm03 podman[52928]: 2026-03-09 15:32:30.627624807 +0000 UTC m=+0.010114458 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T15:32:30.905 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:30 vm03 systemd[1]: Started Ceph mgr.a for f9592f66-1bcc-11f1-9993-3b6a3d16e741. 2026-03-09T15:32:30.905 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:30.783+0000 7ffac3fc1140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T15:32:30.905 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:30.829+0000 7ffac3fc1140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T15:32:31.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-mon[52731]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T15:32:31.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-mon[52731]: monmap epoch 1 2026-03-09T15:32:31.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-mon[52731]: fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:32:31.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-mon[52731]: last_changed 2026-03-09T15:32:26.478905+0000 2026-03-09T15:32:31.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-mon[52731]: created 2026-03-09T15:32:26.478905+0000 2026-03-09T15:32:31.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-mon[52731]: min_mon_release 19 (squid) 2026-03-09T15:32:31.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-mon[52731]: election_strategy: 1 2026-03-09T15:32:31.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-mon[52731]: 0: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.a 2026-03-09T15:32:31.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-mon[52731]: fsmap 2026-03-09T15:32:31.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-mon[52731]: osdmap e1: 0 total, 0 up, 0 in 2026-03-09T15:32:31.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-mon[52731]: mgrmap e1: no daemons active 2026-03-09T15:32:31.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/2083536367' entity='client.admin' 2026-03-09T15:32:31.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:30 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/486361076' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T15:32:31.688 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:31 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:31.316+0000 7ffac3fc1140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T15:32:31.689 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:31 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:31.686+0000 7ffac3fc1140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T15:32:32.066 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:31 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T15:32:32.066 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:31 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T15:32:32.066 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:31 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: from numpy import show_config as show_numpy_config 2026-03-09T15:32:32.066 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:31 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:31.785+0000 7ffac3fc1140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T15:32:32.066 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:31 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:31.827+0000 7ffac3fc1140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T15:32:32.066 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:31 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:31.906+0000 7ffac3fc1140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T15:32:32.710 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:32 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:32.447+0000 7ffac3fc1140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T15:32:32.710 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:32 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:32.572+0000 7ffac3fc1140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T15:32:32.710 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:32 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:32.616+0000 7ffac3fc1140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T15:32:32.710 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:32 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:32.662+0000 7ffac3fc1140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T15:32:32.710 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:32 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:32.708+0000 7ffac3fc1140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T15:32:32.971 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:32 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:32.749+0000 7ffac3fc1140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T15:32:32.971 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:32 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:32.937+0000 7ffac3fc1140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T15:32:33.291 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:33 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:33.012+0000 7ffac3fc1140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T15:32:33.291 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:33 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:33.289+0000 7ffac3fc1140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T15:32:33.548 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:33 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/2469655551' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T15:32:33.558 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout { 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "fsid": "f9592f66-1bcc-11f1-9993-3b6a3d16e741", 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "health": { 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 0 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout ], 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "a" 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout ], 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "btime": "2026-03-09T15:32:28:225350+0000", 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-09T15:32:33.559 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "available": false, 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "restful" 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout ], 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "modified": "2026-03-09T15:32:28.226097+0000", 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout } 2026-03-09T15:32:33.560 INFO:teuthology.orchestra.run.vm03.stdout:mgr not available, waiting (2/15)... 2026-03-09T15:32:33.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:33 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:33.636+0000 7ffac3fc1140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T15:32:33.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:33 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:33.680+0000 7ffac3fc1140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T15:32:33.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:33 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:33.730+0000 7ffac3fc1140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T15:32:34.087 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:33 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:33.827+0000 7ffac3fc1140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T15:32:34.087 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:33 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:33.872+0000 7ffac3fc1140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T15:32:34.087 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:33 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:33.962+0000 7ffac3fc1140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T15:32:34.456 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:34.085+0000 7ffac3fc1140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T15:32:34.456 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:34.232+0000 7ffac3fc1140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T15:32:34.456 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:34.272+0000 7ffac3fc1140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T15:32:34.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-mon[52731]: Activating manager daemon a 2026-03-09T15:32:34.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-mon[52731]: mgrmap e2: a(active, starting, since 0.00657716s) 2026-03-09T15:32:34.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-mon[52731]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T15:32:34.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-mon[52731]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T15:32:34.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-mon[52731]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T15:32:34.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-mon[52731]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T15:32:34.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-mon[52731]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-03-09T15:32:34.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-mon[52731]: Manager daemon a is now available 2026-03-09T15:32:34.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-mon[52731]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-03-09T15:32:34.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-mon[52731]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' 2026-03-09T15:32:34.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-mon[52731]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' 2026-03-09T15:32:34.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-mon[52731]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' 2026-03-09T15:32:34.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:34 vm03 ceph-mon[52731]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout { 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "fsid": "f9592f66-1bcc-11f1-9993-3b6a3d16e741", 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "health": { 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 0 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout ], 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "a" 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout ], 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-09T15:32:35.883 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "btime": "2026-03-09T15:32:28:225350+0000", 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "restful" 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout ], 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "modified": "2026-03-09T15:32:28.226097+0000", 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout }, 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout } 2026-03-09T15:32:35.884 INFO:teuthology.orchestra.run.vm03.stdout:mgr is available 2026-03-09T15:32:36.219 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 2026-03-09T15:32:36.219 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout [global] 2026-03-09T15:32:36.219 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout fsid = f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:32:36.219 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-03-09T15:32:36.219 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mon_host = [v2:192.168.123.103:3300,v1:192.168.123.103:6789] 2026-03-09T15:32:36.219 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-03-09T15:32:36.219 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-03-09T15:32:36.219 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-03-09T15:32:36.219 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-03-09T15:32:36.219 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 2026-03-09T15:32:36.219 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout [mgr] 2026-03-09T15:32:36.219 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-03-09T15:32:36.219 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 2026-03-09T15:32:36.219 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout [osd] 2026-03-09T15:32:36.220 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-03-09T15:32:36.220 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-03-09T15:32:36.220 INFO:teuthology.orchestra.run.vm03.stdout:Enabling cephadm module... 2026-03-09T15:32:36.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:36 vm03 ceph-mon[52731]: mgrmap e3: a(active, since 1.00948s) 2026-03-09T15:32:36.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:36 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/3156349312' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T15:32:36.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:36 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/2516790309' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-03-09T15:32:36.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:36 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/2516790309' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-03-09T15:32:37.490 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:37 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: ignoring --setuser ceph since I am not root 2026-03-09T15:32:37.490 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:37 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: ignoring --setgroup ceph since I am not root 2026-03-09T15:32:37.490 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:37 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:37.322+0000 7fcf32675140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T15:32:37.490 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:37 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:37.375+0000 7fcf32675140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T15:32:37.490 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:37 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/3911967214' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-03-09T15:32:37.490 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:37 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/3911967214' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-03-09T15:32:37.490 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:37 vm03 ceph-mon[52731]: mgrmap e4: a(active, since 2s) 2026-03-09T15:32:37.532 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout { 2026-03-09T15:32:37.532 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "epoch": 4, 2026-03-09T15:32:37.532 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-09T15:32:37.532 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-03-09T15:32:37.532 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-03-09T15:32:37.532 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout } 2026-03-09T15:32:37.532 INFO:teuthology.orchestra.run.vm03.stdout:Waiting for the mgr to restart... 2026-03-09T15:32:37.532 INFO:teuthology.orchestra.run.vm03.stdout:Waiting for mgr epoch 4... 2026-03-09T15:32:38.256 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:37 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:37.885+0000 7fcf32675140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T15:32:38.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:38 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/968644685' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-03-09T15:32:38.566 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:38 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:38.254+0000 7fcf32675140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T15:32:38.566 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:38 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T15:32:38.566 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:38 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T15:32:38.566 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:38 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: from numpy import show_config as show_numpy_config 2026-03-09T15:32:38.566 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:38 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:38.360+0000 7fcf32675140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T15:32:38.566 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:38 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:38.404+0000 7fcf32675140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T15:32:38.566 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:38 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:38.487+0000 7fcf32675140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T15:32:39.316 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:39 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:39.052+0000 7fcf32675140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T15:32:39.316 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:39 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:39.172+0000 7fcf32675140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T15:32:39.316 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:39 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:39.219+0000 7fcf32675140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T15:32:39.316 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:39 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:39.257+0000 7fcf32675140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T15:32:39.316 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:39 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:39.301+0000 7fcf32675140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T15:32:39.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:39 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:39.342+0000 7fcf32675140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T15:32:39.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:39 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:39.528+0000 7fcf32675140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T15:32:39.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:39 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:39.590+0000 7fcf32675140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T15:32:40.166 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:39 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:39.845+0000 7fcf32675140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T15:32:40.471 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:40.164+0000 7fcf32675140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T15:32:40.471 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:40.208+0000 7fcf32675140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T15:32:40.471 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:40.255+0000 7fcf32675140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T15:32:40.471 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:40.338+0000 7fcf32675140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T15:32:40.471 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:40.383+0000 7fcf32675140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T15:32:40.774 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:40.469+0000 7fcf32675140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T15:32:40.775 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:40.598+0000 7fcf32675140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T15:32:41.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: Active manager daemon a restarted 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: Activating manager daemon a 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: osdmap e2: 0 total, 0 up, 0 in 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: mgrmap e5: a(active, starting, since 0.00556168s) 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: Manager daemon a is now available 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:40.772+0000 7fcf32675140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T15:32:41.067 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:40 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:40.814+0000 7fcf32675140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T15:32:42.107 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:41 vm03 ceph-mon[52731]: Found migration_current of "None". Setting to last migration. 2026-03-09T15:32:42.107 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:41 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:32:42.107 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:41 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-03-09T15:32:42.107 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:41 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:32:42.108 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:41 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:32:42.108 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:41 vm03 ceph-mon[52731]: mgrmap e6: a(active, since 1.0089s) 2026-03-09T15:32:42.110 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout { 2026-03-09T15:32:42.110 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 6, 2026-03-09T15:32:42.110 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "initialized": true 2026-03-09T15:32:42.110 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout } 2026-03-09T15:32:42.110 INFO:teuthology.orchestra.run.vm03.stdout:mgr epoch 4 is available 2026-03-09T15:32:42.110 INFO:teuthology.orchestra.run.vm03.stdout:Setting orchestrator backend to cephadm... 2026-03-09T15:32:42.740 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout value unchanged 2026-03-09T15:32:42.740 INFO:teuthology.orchestra.run.vm03.stdout:Using provided ssh private key and signed cert ... 2026-03-09T15:32:42.951 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:42 vm03 ceph-mon[52731]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-03-09T15:32:42.951 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:42 vm03 ceph-mon[52731]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-03-09T15:32:42.951 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:42 vm03 ceph-mon[52731]: [09/Mar/2026:15:32:41] ENGINE Bus STARTING 2026-03-09T15:32:42.951 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:42 vm03 ceph-mon[52731]: [09/Mar/2026:15:32:42] ENGINE Serving on http://192.168.123.103:8765 2026-03-09T15:32:42.951 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:42 vm03 ceph-mon[52731]: [09/Mar/2026:15:32:42] ENGINE Serving on https://192.168.123.103:7150 2026-03-09T15:32:42.951 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:42 vm03 ceph-mon[52731]: [09/Mar/2026:15:32:42] ENGINE Bus STARTED 2026-03-09T15:32:42.951 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:42 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:32:42.951 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:42 vm03 ceph-mon[52731]: [09/Mar/2026:15:32:42] ENGINE Client ('192.168.123.103', 50794) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T15:32:42.951 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:42 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:32:42.951 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:42 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:32:43.364 INFO:teuthology.orchestra.run.vm03.stdout:Adding host vm03... 2026-03-09T15:32:44.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:43 vm03 ceph-mon[52731]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:32:44.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:43 vm03 ceph-mon[52731]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:32:44.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:43 vm03 ceph-mon[52731]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-priv-key", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:32:44.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:43 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:32:44.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:43 vm03 ceph-mon[52731]: Set ssh ssh_identity_key 2026-03-09T15:32:44.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:43 vm03 ceph-mon[52731]: Set ssh private key 2026-03-09T15:32:44.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:43 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:32:44.262 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:43 vm03 ceph-mon[52731]: mgrmap e7: a(active, since 2s) 2026-03-09T15:32:45.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:44 vm03 ceph-mon[52731]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm set-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:32:45.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:44 vm03 ceph-mon[52731]: Set ssh ssh_identity_cert 2026-03-09T15:32:45.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:44 vm03 ceph-mon[52731]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "vm03", "addr": "192.168.123.103", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:32:46.149 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:45 vm03 ceph-mon[52731]: Deploying cephadm binary to vm03 2026-03-09T15:32:46.184 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout Added host 'vm03' with addr '192.168.123.103' 2026-03-09T15:32:46.184 INFO:teuthology.orchestra.run.vm03.stdout:Deploying unmanaged mon service... 2026-03-09T15:32:46.501 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-03-09T15:32:46.501 INFO:teuthology.orchestra.run.vm03.stdout:Deploying unmanaged mgr service... 2026-03-09T15:32:46.815 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-03-09T15:32:47.318 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:47 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:32:47.318 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:47 vm03 ceph-mon[52731]: Added host vm03 2026-03-09T15:32:47.318 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:47 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:32:47.318 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:47 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:32:47.318 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:47 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:32:47.318 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:47 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/2848790341' entity='client.admin' 2026-03-09T15:32:47.415 INFO:teuthology.orchestra.run.vm03.stdout:Enabling the dashboard module... 2026-03-09T15:32:48.489 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:48 vm03 ceph-mon[52731]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:32:48.499 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:48 vm03 ceph-mon[52731]: Saving service mon spec with placement count:5 2026-03-09T15:32:48.499 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:48 vm03 ceph-mon[52731]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:32:48.499 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:48 vm03 ceph-mon[52731]: Saving service mgr spec with placement count:2 2026-03-09T15:32:48.499 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:48 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/1247163211' entity='client.admin' 2026-03-09T15:32:48.499 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:48 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/212755183' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-03-09T15:32:48.499 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:48 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:32:48.499 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:48 vm03 ceph-mon[52731]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:32:48.746 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:48 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: ignoring --setuser ceph since I am not root 2026-03-09T15:32:48.746 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:48 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: ignoring --setgroup ceph since I am not root 2026-03-09T15:32:48.746 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:48 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:48.743+0000 7f8cac90f140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T15:32:48.963 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout { 2026-03-09T15:32:48.963 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "epoch": 8, 2026-03-09T15:32:48.963 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-09T15:32:48.963 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-03-09T15:32:48.963 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-03-09T15:32:48.963 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout } 2026-03-09T15:32:48.963 INFO:teuthology.orchestra.run.vm03.stdout:Waiting for the mgr to restart... 2026-03-09T15:32:48.963 INFO:teuthology.orchestra.run.vm03.stdout:Waiting for mgr epoch 8... 2026-03-09T15:32:49.008 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:48 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:48.797+0000 7f8cac90f140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T15:32:49.550 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:49 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:49.293+0000 7f8cac90f140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T15:32:49.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:49 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/212755183' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-03-09T15:32:49.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:49 vm03 ceph-mon[52731]: mgrmap e8: a(active, since 7s) 2026-03-09T15:32:49.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:49 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/1689810208' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-03-09T15:32:49.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:49 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:49.668+0000 7f8cac90f140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T15:32:49.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:49 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T15:32:49.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:49 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T15:32:49.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:49 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: from numpy import show_config as show_numpy_config 2026-03-09T15:32:49.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:49 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:49.768+0000 7f8cac90f140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T15:32:50.316 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:49 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:49.815+0000 7f8cac90f140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T15:32:50.316 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:49 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:49.899+0000 7f8cac90f140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T15:32:50.744 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:50 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:50.453+0000 7f8cac90f140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T15:32:50.744 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:50 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:50.576+0000 7f8cac90f140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T15:32:50.744 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:50 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:50.624+0000 7f8cac90f140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T15:32:50.744 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:50 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:50.661+0000 7f8cac90f140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T15:32:50.744 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:50 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:50.702+0000 7f8cac90f140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T15:32:50.744 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:50 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:50.742+0000 7f8cac90f140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T15:32:51.066 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:50 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:50.931+0000 7f8cac90f140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T15:32:51.066 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:50 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:50.986+0000 7f8cac90f140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T15:32:51.559 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:51 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:51.222+0000 7f8cac90f140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T15:32:51.559 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:51 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:51.557+0000 7f8cac90f140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T15:32:51.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:51 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:51.598+0000 7f8cac90f140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T15:32:51.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:51 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:51.644+0000 7f8cac90f140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T15:32:51.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:51 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:51.726+0000 7f8cac90f140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T15:32:51.816 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:51 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:51.766+0000 7f8cac90f140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T15:32:52.122 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:51 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:51.851+0000 7f8cac90f140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T15:32:52.122 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:51 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:51.975+0000 7f8cac90f140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T15:32:52.379 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:52 vm03 ceph-mon[52731]: Active manager daemon a restarted 2026-03-09T15:32:52.379 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:52 vm03 ceph-mon[52731]: Activating manager daemon a 2026-03-09T15:32:52.379 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:52 vm03 ceph-mon[52731]: osdmap e3: 0 total, 0 up, 0 in 2026-03-09T15:32:52.379 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:52 vm03 ceph-mon[52731]: mgrmap e9: a(active, starting, since 0.0287036s) 2026-03-09T15:32:52.379 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:52 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T15:32:52.379 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:52 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-03-09T15:32:52.379 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:52 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T15:32:52.379 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:52 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T15:32:52.379 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:52 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T15:32:52.379 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:52 vm03 ceph-mon[52731]: Manager daemon a is now available 2026-03-09T15:32:52.379 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:52 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:52.379 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:52 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:32:52.379 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:52 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:52.120+0000 7f8cac90f140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T15:32:52.379 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:32:52 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:32:52.156+0000 7f8cac90f140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T15:32:53.247 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout { 2026-03-09T15:32:53.247 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 10, 2026-03-09T15:32:53.247 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout "initialized": true 2026-03-09T15:32:53.247 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout } 2026-03-09T15:32:53.247 INFO:teuthology.orchestra.run.vm03.stdout:mgr epoch 8 is available 2026-03-09T15:32:53.248 INFO:teuthology.orchestra.run.vm03.stdout:Generating a dashboard self-signed certificate... 2026-03-09T15:32:53.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:53 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-03-09T15:32:53.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:53 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-03-09T15:32:53.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:53 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:53.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:53 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T15:32:53.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:53 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:53.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:53 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]: dispatch 2026-03-09T15:32:53.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:53 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]': finished 2026-03-09T15:32:53.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:53 vm03 ceph-mon[52731]: mgrmap e10: a(active, since 1.03309s) 2026-03-09T15:32:53.674 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-03-09T15:32:53.674 INFO:teuthology.orchestra.run.vm03.stdout:Creating initial admin user... 2026-03-09T15:32:54.234 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$qoPIQJV47eG/DELauvCgFuFNeM3dEKyJWTl2UKC/Vc7nMxrdAat8W", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1773070374, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-03-09T15:32:54.234 INFO:teuthology.orchestra.run.vm03.stdout:Fetching dashboard port number... 2026-03-09T15:32:54.541 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stdout 8443 2026-03-09T15:32:54.542 INFO:teuthology.orchestra.run.vm03.stdout:firewalld does not appear to be present 2026-03-09T15:32:54.542 INFO:teuthology.orchestra.run.vm03.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-03-09T15:32:54.542 INFO:teuthology.orchestra.run.vm03.stdout:Ceph Dashboard is now available at: 2026-03-09T15:32:54.542 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:32:54.542 INFO:teuthology.orchestra.run.vm03.stdout: URL: https://vm03.local:8443/ 2026-03-09T15:32:54.542 INFO:teuthology.orchestra.run.vm03.stdout: User: admin 2026-03-09T15:32:54.542 INFO:teuthology.orchestra.run.vm03.stdout: Password: 05kewbp20p 2026-03-09T15:32:54.542 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:32:54.543 INFO:teuthology.orchestra.run.vm03.stdout:Saving cluster configuration to /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config directory 2026-03-09T15:32:54.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:54 vm03 ceph-mon[52731]: [09/Mar/2026:15:32:52] ENGINE Bus STARTING 2026-03-09T15:32:54.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:54 vm03 ceph-mon[52731]: [09/Mar/2026:15:32:53] ENGINE Serving on http://192.168.123.103:8765 2026-03-09T15:32:54.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:54 vm03 ceph-mon[52731]: [09/Mar/2026:15:32:53] ENGINE Serving on https://192.168.123.103:7150 2026-03-09T15:32:54.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:54 vm03 ceph-mon[52731]: [09/Mar/2026:15:32:53] ENGINE Bus STARTED 2026-03-09T15:32:54.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:54 vm03 ceph-mon[52731]: [09/Mar/2026:15:32:53] ENGINE Client ('192.168.123.103', 45100) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T15:32:54.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:54 vm03 ceph-mon[52731]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-03-09T15:32:54.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:54 vm03 ceph-mon[52731]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-03-09T15:32:54.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:54 vm03 ceph-mon[52731]: Deploying daemon agent.vm03 on vm03 2026-03-09T15:32:54.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:54 vm03 ceph-mon[52731]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:32:54.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:54 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:54.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:54 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:54.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:54 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:54.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:54 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/3476270388' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout:Or, if you are only running a single cluster on this host: 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout:Please consider enabling telemetry to help improve Ceph: 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout: ceph telemetry on 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout:For more information see: 2026-03-09T15:32:54.887 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:32:54.888 INFO:teuthology.orchestra.run.vm03.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-03-09T15:32:54.888 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:32:54.888 INFO:teuthology.orchestra.run.vm03.stdout:Bootstrap complete. 2026-03-09T15:32:54.941 INFO:tasks.cephadm:Fetching config... 2026-03-09T15:32:54.941 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T15:32:54.941 DEBUG:teuthology.orchestra.run.vm03:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-03-09T15:32:54.972 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-03-09T15:32:54.972 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T15:32:54.972 DEBUG:teuthology.orchestra.run.vm03:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-03-09T15:32:55.032 INFO:tasks.cephadm:Fetching mon keyring... 2026-03-09T15:32:55.032 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T15:32:55.032 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/keyring of=/dev/stdout 2026-03-09T15:32:55.117 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-03-09T15:32:55.530 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:32:55.798 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:55 vm03 ceph-mon[52731]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:32:55.798 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:55 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/713162957' entity='client.admin' 2026-03-09T15:32:55.798 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:55 vm03 ceph-mon[52731]: mgrmap e11: a(active, since 2s) 2026-03-09T15:32:55.798 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:55 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:55.798 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:55 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:55.798 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:55 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:55.798 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:55 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:32:55.798 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:55 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:55.798 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:55 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:55.798 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:55 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:55.798 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:55 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:55.798 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:55 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:55.798 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:55 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:32:55.798 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:55 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:55.973 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-03-09T15:32:55.973 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-03-09T15:32:56.255 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:32:56.745 INFO:tasks.cephadm:Writing (initial) conf and keyring to vm04 2026-03-09T15:32:56.745 DEBUG:teuthology.orchestra.run.vm04:> set -ex 2026-03-09T15:32:56.745 DEBUG:teuthology.orchestra.run.vm04:> dd of=/etc/ceph/ceph.conf 2026-03-09T15:32:56.764 DEBUG:teuthology.orchestra.run.vm04:> set -ex 2026-03-09T15:32:56.764 DEBUG:teuthology.orchestra.run.vm04:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-03-09T15:32:56.820 INFO:tasks.cephadm:Adding host vm04 to orchestrator... 2026-03-09T15:32:56.820 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph orch host add vm04 2026-03-09T15:32:57.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:56 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:57.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:56 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/3693315228' entity='client.admin' 2026-03-09T15:32:57.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:56 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:32:57.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:56 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:57.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:56 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:57.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:56 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:57.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:56 vm03 ceph-mon[52731]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:32:57.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:56 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:57.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:56 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:32:57.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:56 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:32:57.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:56 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:32:57.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:56 vm03 ceph-mon[52731]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T15:32:57.133 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:32:58.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:58 vm03 ceph-mon[52731]: Updating vm03:/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config/ceph.conf 2026-03-09T15:32:58.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:58 vm03 ceph-mon[52731]: Updating vm03:/etc/ceph/ceph.client.admin.keyring 2026-03-09T15:32:58.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:58 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:58.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:58 vm03 ceph-mon[52731]: Updating vm03:/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config/ceph.client.admin.keyring 2026-03-09T15:32:58.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:58 vm03 ceph-mon[52731]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "vm04", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:32:58.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:58 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:58.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:58 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:58.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:58 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:58.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:58 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:58.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:58 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:32:59.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:59 vm03 ceph-mon[52731]: Deploying cephadm binary to vm04 2026-03-09T15:32:59.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:32:59 vm03 ceph-mon[52731]: mgrmap e12: a(active, since 6s) 2026-03-09T15:33:00.069 INFO:teuthology.orchestra.run.vm03.stdout:Added host 'vm04' with addr '192.168.123.104' 2026-03-09T15:33:00.121 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph orch host ls --format=json 2026-03-09T15:33:00.324 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:00.591 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:33:00.591 INFO:teuthology.orchestra.run.vm03.stdout:[{"addr": "192.168.123.103", "hostname": "vm03", "labels": [], "status": ""}, {"addr": "192.168.123.104", "hostname": "vm04", "labels": [], "status": ""}] 2026-03-09T15:33:00.683 INFO:tasks.cephadm:Setting crush tunables to default 2026-03-09T15:33:00.683 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph osd crush tunables default 2026-03-09T15:33:00.894 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:01.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:01 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:01.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:01 vm03 ceph-mon[52731]: Added host vm04 2026-03-09T15:33:01.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:01 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:01.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:01 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:01.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:01 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:01.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:01 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:01.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:01 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:vm04", "name": "osd_memory_target"}]: dispatch 2026-03-09T15:33:01.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:01 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:01.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:01 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:01.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:01 vm03 ceph-mon[52731]: Updating vm04:/etc/ceph/ceph.conf 2026-03-09T15:33:01.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:01 vm03 ceph-mon[52731]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T15:33:01.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:01 vm03 ceph-mon[52731]: Updating vm04:/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config/ceph.conf 2026-03-09T15:33:01.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:01 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:01.317 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:01 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:02.074 INFO:teuthology.orchestra.run.vm03.stderr:adjusted tunables profile to default 2026-03-09T15:33:02.155 INFO:tasks.cephadm:Adding mon.a on vm03 2026-03-09T15:33:02.155 INFO:tasks.cephadm:Adding mon.b on vm04 2026-03-09T15:33:02.155 DEBUG:teuthology.orchestra.run.vm04:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph orch apply mon '2;vm03:192.168.123.103=a;vm04:192.168.123.104=b' 2026-03-09T15:33:02.488 INFO:teuthology.orchestra.run.vm04.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config/ceph.conf 2026-03-09T15:33:02.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:02 vm03 ceph-mon[52731]: Updating vm04:/etc/ceph/ceph.client.admin.keyring 2026-03-09T15:33:02.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:02 vm03 ceph-mon[52731]: Updating vm04:/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config/ceph.client.admin.keyring 2026-03-09T15:33:02.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:02 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm04", "caps": []}]: dispatch 2026-03-09T15:33:02.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:02 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.vm04", "caps": []}]': finished 2026-03-09T15:33:02.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:02 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/2220055413' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-03-09T15:33:02.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:02 vm03 ceph-mon[52731]: Deploying daemon agent.vm04 on vm04 2026-03-09T15:33:02.835 INFO:teuthology.orchestra.run.vm04.stdout:Scheduled mon update... 2026-03-09T15:33:02.911 DEBUG:teuthology.orchestra.run.vm04:mon.b> sudo journalctl -f -n 0 -u ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mon.b.service 2026-03-09T15:33:02.913 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-03-09T15:33:02.913 DEBUG:teuthology.orchestra.run.vm04:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph mon dump -f json 2026-03-09T15:33:03.241 INFO:teuthology.orchestra.run.vm04.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config/ceph.conf 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/2220055413' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T15:33:03.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:03 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:03.659 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:33:03.660 INFO:teuthology.orchestra.run.vm04.stdout:{"epoch":1,"fsid":"f9592f66-1bcc-11f1-9993-3b6a3d16e741","modified":"2026-03-09T15:32:26.478905Z","created":"2026-03-09T15:32:26.478905Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:3300","nonce":0},{"type":"v1","addr":"192.168.123.103:6789","nonce":0}]},"addr":"192.168.123.103:6789/0","public_addr":"192.168.123.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-03-09T15:33:03.660 INFO:teuthology.orchestra.run.vm04.stderr:dumped monmap epoch 1 2026-03-09T15:33:04.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:04 vm03 ceph-mon[52731]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;vm03:192.168.123.103=a;vm04:192.168.123.104=b", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:04.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:04 vm03 ceph-mon[52731]: Saving service mon spec with placement vm03:192.168.123.103=a;vm04:192.168.123.104=b;count:2 2026-03-09T15:33:04.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:04 vm03 ceph-mon[52731]: Deploying daemon mon.b on vm04 2026-03-09T15:33:04.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:04 vm03 ceph-mon[52731]: from='client.? 192.168.123.104:0/1200682122' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.591 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 podman[53022]: 2026-03-09 15:33:04.58609453 +0000 UTC m=+0.063160563 container init e4f9adf920cb679cd2a00c4bd8090432ff900e7e625fae38202ebd31b083d87f (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-b, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_REF=squid, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS) 2026-03-09T15:33:04.591 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 podman[53022]: 2026-03-09 15:33:04.58959852 +0000 UTC m=+0.066664544 container start e4f9adf920cb679cd2a00c4bd8090432ff900e7e625fae38202ebd31b083d87f (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-b, org.label-schema.schema-version=1.0, CEPH_REF=squid, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default) 2026-03-09T15:33:04.781 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-03-09T15:33:04.781 DEBUG:teuthology.orchestra.run.vm04:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph mon dump -f json 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 bash[53022]: e4f9adf920cb679cd2a00c4bd8090432ff900e7e625fae38202ebd31b083d87f 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 podman[53022]: 2026-03-09 15:33:04.534684209 +0000 UTC m=+0.011750242 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 systemd[1]: Started Ceph mon.b for f9592f66-1bcc-11f1-9993-3b6a3d16e741. 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: set uid:gid to 167:167 (ceph:ceph) 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable), process ceph-mon, pid 2 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: pidfile_write: ignore empty --pid-file 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: load: jerasure load: lrc 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: RocksDB version: 7.9.2 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Git sha 0 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Compile date 2026-02-25 18:11:04 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: DB SUMMARY 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: DB Session ID: PTQ5UAKUVZ1NUXASL9U4 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: CURRENT file: CURRENT 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: IDENTITY file: IDENTITY 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 511 ; 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.error_if_exists: 0 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.create_if_missing: 0 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.paranoid_checks: 1 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.flush_verify_memtable_count: 1 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.env: 0x559d1ab04dc0 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.fs: PosixFileSystem 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.info_log: 0x559d1b704700 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_file_opening_threads: 16 2026-03-09T15:33:04.884 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.statistics: (nil) 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.use_fsync: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_log_file_size: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.log_file_time_to_roll: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.keep_log_file_num: 1000 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.recycle_log_file_num: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.allow_fallocate: 1 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.allow_mmap_reads: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.allow_mmap_writes: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.use_direct_reads: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.create_missing_column_families: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.db_log_dir: 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.wal_dir: 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.table_cache_numshardbits: 6 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.WAL_ttl_seconds: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.WAL_size_limit_MB: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.is_fd_close_on_exec: 1 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.advise_random_on_open: 1 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.db_write_buffer_size: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.write_buffer_manager: 0x559d1b709900 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.use_adaptive_mutex: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.rate_limiter: (nil) 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.wal_recovery_mode: 2 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.enable_thread_tracking: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.enable_pipelined_write: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.unordered_write: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.row_cache: None 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.wal_filter: None 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.allow_ingest_behind: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.two_write_queues: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.manual_wal_flush: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.wal_compression: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.atomic_flush: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.persist_stats_to_disk: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.write_dbid_to_manifest: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.log_readahead_size: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.best_efforts_recovery: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.allow_data_in_errors: 0 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.db_host_id: __hostname__ 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.enforce_single_del_contracts: true 2026-03-09T15:33:04.885 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_background_jobs: 2 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_background_compactions: -1 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_subcompactions: 1 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.delayed_write_rate : 16777216 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_total_wal_size: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.stats_dump_period_sec: 600 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.stats_persist_period_sec: 600 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_open_files: -1 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.bytes_per_sync: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.wal_bytes_per_sync: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.strict_bytes_per_sync: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compaction_readahead_size: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_background_flushes: -1 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Compression algorithms supported: 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: kZSTD supported: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: kXpressCompression supported: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: kBZip2Compression supported: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: kLZ4Compression supported: 1 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: kZlibCompression supported: 1 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: kLZ4HCCompression supported: 1 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: kSnappyCompression supported: 1 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Fast CRC32 supported: Supported on x86 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: DMutex implementation: pthread_mutex_t 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.merge_operator: 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compaction_filter: None 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compaction_filter_factory: None 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.sst_partitioner_factory: None 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.memtable_factory: SkipListFactory 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.table_factory: BlockBasedTable 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559d1b704640) 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: cache_index_and_filter_blocks: 1 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: pin_top_level_index_and_filter: 1 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: index_type: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: data_block_index_type: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: index_shortening: 1 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: data_block_hash_table_util_ratio: 0.750000 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: checksum: 4 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: no_block_cache: 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: block_cache: 0x559d1b729350 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: block_cache_name: BinnedLRUCache 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: block_cache_options: 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: capacity : 536870912 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: num_shard_bits : 4 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: strict_capacity_limit : 0 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: high_pri_pool_ratio: 0.000 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: block_cache_compressed: (nil) 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: persistent_cache: (nil) 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: block_size: 4096 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: block_size_deviation: 10 2026-03-09T15:33:04.886 INFO:journalctl@ceph.mon.b.vm04.stdout: block_restart_interval: 16 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: index_block_restart_interval: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: metadata_block_size: 4096 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: partition_filters: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: use_delta_encoding: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: filter_policy: bloomfilter 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: whole_key_filtering: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: verify_compression: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: read_amp_bytes_per_bit: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: format_version: 5 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: enable_index_compression: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: block_align: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: max_auto_readahead_size: 262144 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: prepopulate_block_cache: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: initial_auto_readahead_size: 8192 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout: num_file_reads_for_auto_readahead: 2 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.write_buffer_size: 33554432 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_write_buffer_number: 2 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compression: NoCompression 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.bottommost_compression: Disabled 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.prefix_extractor: nullptr 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.num_levels: 7 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compression_opts.window_bits: -14 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compression_opts.level: 32767 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compression_opts.strategy: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compression_opts.enabled: false 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.target_file_size_base: 67108864 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.target_file_size_multiplier: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-03-09T15:33:04.887 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.arena_block_size: 1048576 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.disable_auto_compactions: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.inplace_update_support: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.inplace_update_num_locks: 10000 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.memtable_huge_page_size: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.bloom_locality: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.max_successive_merges: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.optimize_filters_for_hits: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.paranoid_file_checks: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.force_consistency_checks: 1 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.report_bg_io_stats: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.ttl: 2592000 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.periodic_compaction_seconds: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.enable_blob_files: false 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.min_blob_size: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.blob_file_size: 268435456 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.blob_compression_type: NoCompression 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.enable_blob_garbage_collection: false 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.blob_file_starting_level: 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a313ec6d-9912-4bd4-9715-ad9916a43de9 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773070384631247, "job": 1, "event": "recovery_started", "wal_files": [4]} 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773070384631853, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1643, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1773070384, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a313ec6d-9912-4bd4-9715-ad9916a43de9", "db_session_id": "PTQ5UAKUVZ1NUXASL9U4", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773070384631911, "job": 1, "event": "recovery_finished"} 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559d1b72ae00 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: DB pointer 0x559d1b840000 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b does not exist in monmap, will attempt to join an existing cluster 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: using public_addr v2:192.168.123.104:0/0 -> [v2:192.168.123.104:3300/0,v1:192.168.123.104:6789/0] 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: starting mon.b rank -1 at public addrs [v2:192.168.123.104:3300/0,v1:192.168.123.104:6789/0] at bind addrs [v2:192.168.123.104:3300/0,v1:192.168.123.104:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout: ** DB Stats ** 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-03-09T15:33:04.888 INFO:journalctl@ceph.mon.b.vm04.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: ** Compaction Stats [default] ** 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: L0 1/0 1.60 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Sum 1/0 1.60 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: ** Compaction Stats [default] ** 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: AddFile(Keys): cumulative 0, interval 0 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Cumulative compaction: 0.00 GB write, 0.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Interval compaction: 0.00 GB write, 0.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Block cache BinnedLRUCache@0x559d1b729350#2 capacity: 512.00 MB usage: 0.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.8e-05 secs_since: 0 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: Block cache entry stats(count,size,portion): DataBlock(1,0.64 KB,0.00012219%) FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: ** File Read Latency Histogram By Level [default] ** 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b@-1(???) e0 preinit fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b@-1(synchronizing).mds e1 new map 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b@-1(synchronizing).mds e1 print_map 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: e1 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: btime 2026-03-09T15:32:28:225350+0000 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: legacy client fscid: -1 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout: No filesystems configured 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mkfs f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: monmap epoch 1 2026-03-09T15:33:04.889 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: last_changed 2026-03-09T15:32:26.478905+0000 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: created 2026-03-09T15:32:26.478905+0000 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: min_mon_release 19 (squid) 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: election_strategy: 1 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: 0: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.a 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: fsmap 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: osdmap e1: 0 total, 0 up, 0 in 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mgrmap e1: no daemons active 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/4207432642' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/1328568282' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/1328568282' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: monmap epoch 1 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: last_changed 2026-03-09T15:32:26.478905+0000 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: created 2026-03-09T15:32:26.478905+0000 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: min_mon_release 19 (squid) 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: election_strategy: 1 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: 0: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.a 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: fsmap 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: osdmap e1: 0 total, 0 up, 0 in 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mgrmap e1: no daemons active 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/2083536367' entity='client.admin' 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/486361076' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/2469655551' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Activating manager daemon a 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mgrmap e2: a(active, starting, since 0.00657716s) 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Manager daemon a is now available 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14100 192.168.123.103:0/402226496' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mgrmap e3: a(active, since 1.00948s) 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/3156349312' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/2516790309' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/2516790309' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/3911967214' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/3911967214' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mgrmap e4: a(active, since 2s) 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/968644685' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Active manager daemon a restarted 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Activating manager daemon a 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: osdmap e2: 0 total, 0 up, 0 in 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mgrmap e5: a(active, starting, since 0.00556168s) 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Manager daemon a is now available 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:33:04.890 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Found migration_current of "None". Setting to last migration. 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mgrmap e6: a(active, since 1.0089s) 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: [09/Mar/2026:15:32:41] ENGINE Bus STARTING 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: [09/Mar/2026:15:32:42] ENGINE Serving on http://192.168.123.103:8765 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: [09/Mar/2026:15:32:42] ENGINE Serving on https://192.168.123.103:7150 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: [09/Mar/2026:15:32:42] ENGINE Bus STARTED 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: [09/Mar/2026:15:32:42] ENGINE Client ('192.168.123.103', 50794) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-priv-key", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Set ssh ssh_identity_key 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Set ssh private key 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mgrmap e7: a(active, since 2s) 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm set-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Set ssh ssh_identity_cert 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "vm03", "addr": "192.168.123.103", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Deploying cephadm binary to vm03 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Added host vm03 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/2848790341' entity='client.admin' 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Saving service mon spec with placement count:5 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Saving service mgr spec with placement count:2 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/1247163211' entity='client.admin' 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/212755183' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14118 192.168.123.103:0/595515314' entity='mgr.a' 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/212755183' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mgrmap e8: a(active, since 7s) 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/1689810208' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Active manager daemon a restarted 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Activating manager daemon a 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: osdmap e3: 0 total, 0 up, 0 in 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mgrmap e9: a(active, starting, since 0.0287036s) 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Manager daemon a is now available 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-03-09T15:33:04.891 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]': finished 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mgrmap e10: a(active, since 1.03309s) 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: [09/Mar/2026:15:32:52] ENGINE Bus STARTING 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: [09/Mar/2026:15:32:53] ENGINE Serving on http://192.168.123.103:8765 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: [09/Mar/2026:15:32:53] ENGINE Serving on https://192.168.123.103:7150 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: [09/Mar/2026:15:32:53] ENGINE Bus STARTED 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: [09/Mar/2026:15:32:53] ENGINE Client ('192.168.123.103', 45100) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Deploying daemon agent.vm03 on vm03 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/3476270388' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/713162957' entity='client.admin' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mgrmap e11: a(active, since 2s) 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/3693315228' entity='client.admin' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Updating vm03:/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config/ceph.conf 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Updating vm03:/etc/ceph/ceph.client.admin.keyring 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Updating vm03:/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config/ceph.client.admin.keyring 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "vm04", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Deploying cephadm binary to vm04 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mgrmap e12: a(active, since 6s) 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Added host vm04 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.892 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:vm04", "name": "osd_memory_target"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Updating vm04:/etc/ceph/ceph.conf 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Updating vm04:/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config/ceph.conf 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Updating vm04:/etc/ceph/ceph.client.admin.keyring 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Updating vm04:/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config/ceph.client.admin.keyring 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm04", "caps": []}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.vm04", "caps": []}]': finished 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/2220055413' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Deploying daemon agent.vm04 on vm04 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/2220055413' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;vm03:192.168.123.103=a;vm04:192.168.123.104=b", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Saving service mon spec with placement vm03:192.168.123.103=a;vm04:192.168.123.104=b;count:2 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: Deploying daemon mon.b on vm04 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: from='client.? 192.168.123.104:0/1200682122' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T15:33:04.893 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:04 vm04 ceph-mon[53036]: mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2026-03-09T15:33:05.035 INFO:teuthology.orchestra.run.vm04.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.b/config 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: mon.a calling monitor election 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: mon.b calling monitor election 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: monmap epoch 2 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: last_changed 2026-03-09T15:33:04.669740+0000 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: created 2026-03-09T15:32:26.478905+0000 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: min_mon_release 19 (squid) 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: election_strategy: 1 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: 0: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.a 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: 1: [v2:192.168.123.104:3300/0,v1:192.168.123.104:6789/0] mon.b 2026-03-09T15:33:10.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: fsmap 2026-03-09T15:33:10.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T15:33:10.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: mgrmap e12: a(active, since 17s) 2026-03-09T15:33:10.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: overall HEALTH_OK 2026-03-09T15:33:10.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:10.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:10.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:09 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: mon.a calling monitor election 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: mon.b calling monitor election 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: monmap epoch 2 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: last_changed 2026-03-09T15:33:04.669740+0000 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: created 2026-03-09T15:32:26.478905+0000 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: min_mon_release 19 (squid) 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: election_strategy: 1 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: 0: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.a 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: 1: [v2:192.168.123.104:3300/0,v1:192.168.123.104:6789/0] mon.b 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: fsmap 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: mgrmap e12: a(active, since 17s) 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: overall HEALTH_OK 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:10.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:09 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: Updating vm04:/etc/ceph/ceph.conf 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: Updating vm03:/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config/ceph.conf 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: Updating vm04:/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config/ceph.conf 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: Reconfiguring mon.a (unknown last config time)... 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: Reconfiguring daemon mon.a on vm03 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: Reconfiguring mon.b (monmap changed)... 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T15:33:10.809 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:10.810 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: Reconfiguring daemon mon.b on vm04 2026-03-09T15:33:10.810 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.810 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.810 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:10.810 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:10.810 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:10.810 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:10.810 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:10 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T15:33:11.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T15:33:11.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: Updating vm04:/etc/ceph/ceph.conf 2026-03-09T15:33:11.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:11.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:11.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: Updating vm03:/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config/ceph.conf 2026-03-09T15:33:11.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: Updating vm04:/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/config/ceph.conf 2026-03-09T15:33:11.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:11.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:11.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: Reconfiguring mon.a (unknown last config time)... 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: Reconfiguring daemon mon.a on vm03 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: Reconfiguring mon.b (monmap changed)... 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: Reconfiguring daemon mon.b on vm04 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:11.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:10 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T15:33:11.350 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:33:11.350 INFO:teuthology.orchestra.run.vm04.stdout:{"epoch":2,"fsid":"f9592f66-1bcc-11f1-9993-3b6a3d16e741","modified":"2026-03-09T15:33:04.669740Z","created":"2026-03-09T15:32:26.478905Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:3300","nonce":0},{"type":"v1","addr":"192.168.123.103:6789","nonce":0}]},"addr":"192.168.123.103:6789/0","public_addr":"192.168.123.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.104:3300","nonce":0},{"type":"v1","addr":"192.168.123.104:6789","nonce":0}]},"addr":"192.168.123.104:6789/0","public_addr":"192.168.123.104:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2026-03-09T15:33:11.350 INFO:teuthology.orchestra.run.vm04.stderr:dumped monmap epoch 2 2026-03-09T15:33:11.412 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-03-09T15:33:11.412 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph config generate-minimal-conf 2026-03-09T15:33:11.611 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:11.694 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:33:11 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a[52939]: 2026-03-09T15:33:11.667+0000 7f8c78c76640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-03-09T15:33:11.877 INFO:teuthology.orchestra.run.vm03.stdout:# minimal ceph.conf for f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:33:11.877 INFO:teuthology.orchestra.run.vm03.stdout:[global] 2026-03-09T15:33:11.877 INFO:teuthology.orchestra.run.vm03.stdout: fsid = f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:33:11.877 INFO:teuthology.orchestra.run.vm03.stdout: mon_host = [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] [v2:192.168.123.104:3300/0,v1:192.168.123.104:6789/0] 2026-03-09T15:33:11.929 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-03-09T15:33:11.929 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T15:33:11.930 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/etc/ceph/ceph.conf 2026-03-09T15:33:11.954 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:11 vm03 ceph-mon[52731]: from='client.? 192.168.123.104:0/241393759' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T15:33:11.958 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T15:33:11.958 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-03-09T15:33:12.024 DEBUG:teuthology.orchestra.run.vm04:> set -ex 2026-03-09T15:33:12.024 DEBUG:teuthology.orchestra.run.vm04:> sudo dd of=/etc/ceph/ceph.conf 2026-03-09T15:33:12.051 DEBUG:teuthology.orchestra.run.vm04:> set -ex 2026-03-09T15:33:12.051 DEBUG:teuthology.orchestra.run.vm04:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-03-09T15:33:12.114 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:11 vm04 ceph-mon[53036]: from='client.? 192.168.123.104:0/241393759' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T15:33:12.118 INFO:tasks.cephadm:Adding mgr.a on vm03 2026-03-09T15:33:12.118 INFO:tasks.cephadm:Adding mgr.b on vm04 2026-03-09T15:33:12.118 DEBUG:teuthology.orchestra.run.vm04:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph orch apply mgr '2;vm03=a;vm04=b' 2026-03-09T15:33:12.331 INFO:teuthology.orchestra.run.vm04.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.b/config 2026-03-09T15:33:12.578 INFO:teuthology.orchestra.run.vm04.stdout:Scheduled mgr update... 2026-03-09T15:33:12.638 DEBUG:teuthology.orchestra.run.vm04:mgr.b> sudo journalctl -f -n 0 -u ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mgr.b.service 2026-03-09T15:33:12.640 INFO:tasks.cephadm:Deploying OSDs... 2026-03-09T15:33:12.640 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T15:33:12.640 DEBUG:teuthology.orchestra.run.vm03:> dd if=/scratch_devs of=/dev/stdout 2026-03-09T15:33:12.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T15:33:12.658 DEBUG:teuthology.orchestra.run.vm03:> ls /dev/[sv]d? 2026-03-09T15:33:12.714 INFO:teuthology.orchestra.run.vm03.stdout:/dev/vda 2026-03-09T15:33:12.714 INFO:teuthology.orchestra.run.vm03.stdout:/dev/vdb 2026-03-09T15:33:12.714 INFO:teuthology.orchestra.run.vm03.stdout:/dev/vdc 2026-03-09T15:33:12.714 INFO:teuthology.orchestra.run.vm03.stdout:/dev/vdd 2026-03-09T15:33:12.714 INFO:teuthology.orchestra.run.vm03.stdout:/dev/vde 2026-03-09T15:33:12.714 WARNING:teuthology.misc:Removing root device: /dev/vda from device list 2026-03-09T15:33:12.715 DEBUG:teuthology.misc:devs=['/dev/vdb', '/dev/vdc', '/dev/vdd', '/dev/vde'] 2026-03-09T15:33:12.715 DEBUG:teuthology.orchestra.run.vm03:> stat /dev/vdb 2026-03-09T15:33:12.775 INFO:teuthology.orchestra.run.vm03.stdout: File: /dev/vdb 2026-03-09T15:33:12.775 INFO:teuthology.orchestra.run.vm03.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T15:33:12.775 INFO:teuthology.orchestra.run.vm03.stdout:Device: 6h/6d Inode: 221 Links: 1 Device type: fc,10 2026-03-09T15:33:12.775 INFO:teuthology.orchestra.run.vm03.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T15:33:12.775 INFO:teuthology.orchestra.run.vm03.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T15:33:12.775 INFO:teuthology.orchestra.run.vm03.stdout:Access: 2026-03-09 15:32:57.185968397 +0000 2026-03-09T15:33:12.775 INFO:teuthology.orchestra.run.vm03.stdout:Modify: 2026-03-09 15:29:49.467694117 +0000 2026-03-09T15:33:12.775 INFO:teuthology.orchestra.run.vm03.stdout:Change: 2026-03-09 15:29:49.467694117 +0000 2026-03-09T15:33:12.775 INFO:teuthology.orchestra.run.vm03.stdout: Birth: 2026-03-09 15:26:46.258000000 +0000 2026-03-09T15:33:12.775 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/vdb of=/dev/null count=1 2026-03-09T15:33:12.842 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records in 2026-03-09T15:33:12.842 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records out 2026-03-09T15:33:12.842 INFO:teuthology.orchestra.run.vm03.stderr:512 bytes copied, 0.000201357 s, 2.5 MB/s 2026-03-09T15:33:12.843 DEBUG:teuthology.orchestra.run.vm03:> ! mount | grep -v devtmpfs | grep -q /dev/vdb 2026-03-09T15:33:12.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:12 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/1033364514' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:12.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:12 vm04 ceph-mon[53036]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:12.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:12 vm04 ceph-mon[53036]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;vm03=a;vm04=b", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:12.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:12 vm04 ceph-mon[53036]: Saving service mgr spec with placement vm03=a;vm04=b;count:2 2026-03-09T15:33:12.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:12 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:12.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:12 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:12.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:12 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:12.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:12 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:12.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:12 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:12.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:12 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T15:33:12.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:12 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-03-09T15:33:12.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:12 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T15:33:12.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:12 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:12.888 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:12 vm04 ceph-mon[53036]: Deploying daemon mgr.b on vm04 2026-03-09T15:33:12.903 DEBUG:teuthology.orchestra.run.vm03:> stat /dev/vdc 2026-03-09T15:33:12.962 INFO:teuthology.orchestra.run.vm03.stdout: File: /dev/vdc 2026-03-09T15:33:12.962 INFO:teuthology.orchestra.run.vm03.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T15:33:12.962 INFO:teuthology.orchestra.run.vm03.stdout:Device: 6h/6d Inode: 222 Links: 1 Device type: fc,20 2026-03-09T15:33:12.962 INFO:teuthology.orchestra.run.vm03.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T15:33:12.962 INFO:teuthology.orchestra.run.vm03.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T15:33:12.962 INFO:teuthology.orchestra.run.vm03.stdout:Access: 2026-03-09 15:32:57.190968404 +0000 2026-03-09T15:33:12.962 INFO:teuthology.orchestra.run.vm03.stdout:Modify: 2026-03-09 15:29:49.444694081 +0000 2026-03-09T15:33:12.962 INFO:teuthology.orchestra.run.vm03.stdout:Change: 2026-03-09 15:29:49.444694081 +0000 2026-03-09T15:33:12.962 INFO:teuthology.orchestra.run.vm03.stdout: Birth: 2026-03-09 15:26:46.262000000 +0000 2026-03-09T15:33:12.963 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/vdc of=/dev/null count=1 2026-03-09T15:33:13.028 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records in 2026-03-09T15:33:13.028 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records out 2026-03-09T15:33:13.028 INFO:teuthology.orchestra.run.vm03.stderr:512 bytes copied, 0.000189094 s, 2.7 MB/s 2026-03-09T15:33:13.029 DEBUG:teuthology.orchestra.run.vm03:> ! mount | grep -v devtmpfs | grep -q /dev/vdc 2026-03-09T15:33:13.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:12 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/1033364514' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:13.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:12 vm03 ceph-mon[52731]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:13.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:12 vm03 ceph-mon[52731]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;vm03=a;vm04=b", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:13.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:12 vm03 ceph-mon[52731]: Saving service mgr spec with placement vm03=a;vm04=b;count:2 2026-03-09T15:33:13.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:12 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:13.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:12 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:13.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:12 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:13.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:12 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:13.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:12 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:13.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:12 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T15:33:13.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:12 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-03-09T15:33:13.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:12 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T15:33:13.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:12 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:13.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:12 vm03 ceph-mon[52731]: Deploying daemon mgr.b on vm04 2026-03-09T15:33:13.085 DEBUG:teuthology.orchestra.run.vm03:> stat /dev/vdd 2026-03-09T15:33:13.144 INFO:teuthology.orchestra.run.vm03.stdout: File: /dev/vdd 2026-03-09T15:33:13.144 INFO:teuthology.orchestra.run.vm03.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T15:33:13.144 INFO:teuthology.orchestra.run.vm03.stdout:Device: 6h/6d Inode: 256 Links: 1 Device type: fc,30 2026-03-09T15:33:13.144 INFO:teuthology.orchestra.run.vm03.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T15:33:13.144 INFO:teuthology.orchestra.run.vm03.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T15:33:13.144 INFO:teuthology.orchestra.run.vm03.stdout:Access: 2026-03-09 15:32:57.197968415 +0000 2026-03-09T15:33:13.144 INFO:teuthology.orchestra.run.vm03.stdout:Modify: 2026-03-09 15:29:49.458694103 +0000 2026-03-09T15:33:13.144 INFO:teuthology.orchestra.run.vm03.stdout:Change: 2026-03-09 15:29:49.458694103 +0000 2026-03-09T15:33:13.144 INFO:teuthology.orchestra.run.vm03.stdout: Birth: 2026-03-09 15:26:46.305000000 +0000 2026-03-09T15:33:13.144 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/vdd of=/dev/null count=1 2026-03-09T15:33:13.216 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records in 2026-03-09T15:33:13.216 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records out 2026-03-09T15:33:13.216 INFO:teuthology.orchestra.run.vm03.stderr:512 bytes copied, 0.000191307 s, 2.7 MB/s 2026-03-09T15:33:13.218 DEBUG:teuthology.orchestra.run.vm03:> ! mount | grep -v devtmpfs | grep -q /dev/vdd 2026-03-09T15:33:13.279 DEBUG:teuthology.orchestra.run.vm03:> stat /dev/vde 2026-03-09T15:33:13.342 INFO:teuthology.orchestra.run.vm03.stdout: File: /dev/vde 2026-03-09T15:33:13.342 INFO:teuthology.orchestra.run.vm03.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T15:33:13.342 INFO:teuthology.orchestra.run.vm03.stdout:Device: 6h/6d Inode: 257 Links: 1 Device type: fc,40 2026-03-09T15:33:13.342 INFO:teuthology.orchestra.run.vm03.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T15:33:13.342 INFO:teuthology.orchestra.run.vm03.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T15:33:13.342 INFO:teuthology.orchestra.run.vm03.stdout:Access: 2026-03-09 15:32:57.202968422 +0000 2026-03-09T15:33:13.342 INFO:teuthology.orchestra.run.vm03.stdout:Modify: 2026-03-09 15:29:49.456694100 +0000 2026-03-09T15:33:13.342 INFO:teuthology.orchestra.run.vm03.stdout:Change: 2026-03-09 15:29:49.456694100 +0000 2026-03-09T15:33:13.342 INFO:teuthology.orchestra.run.vm03.stdout: Birth: 2026-03-09 15:26:46.306000000 +0000 2026-03-09T15:33:13.343 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/vde of=/dev/null count=1 2026-03-09T15:33:13.441 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records in 2026-03-09T15:33:13.441 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records out 2026-03-09T15:33:13.441 INFO:teuthology.orchestra.run.vm03.stderr:512 bytes copied, 0.000797563 s, 642 kB/s 2026-03-09T15:33:13.442 DEBUG:teuthology.orchestra.run.vm03:> ! mount | grep -v devtmpfs | grep -q /dev/vde 2026-03-09T15:33:13.459 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:13 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:13.457+0000 7f9340f7f140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T15:33:13.476 DEBUG:teuthology.orchestra.run.vm04:> set -ex 2026-03-09T15:33:13.476 DEBUG:teuthology.orchestra.run.vm04:> dd if=/scratch_devs of=/dev/stdout 2026-03-09T15:33:13.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T15:33:13.498 DEBUG:teuthology.orchestra.run.vm04:> ls /dev/[sv]d? 2026-03-09T15:33:13.559 INFO:teuthology.orchestra.run.vm04.stdout:/dev/vda 2026-03-09T15:33:13.559 INFO:teuthology.orchestra.run.vm04.stdout:/dev/vdb 2026-03-09T15:33:13.559 INFO:teuthology.orchestra.run.vm04.stdout:/dev/vdc 2026-03-09T15:33:13.559 INFO:teuthology.orchestra.run.vm04.stdout:/dev/vdd 2026-03-09T15:33:13.559 INFO:teuthology.orchestra.run.vm04.stdout:/dev/vde 2026-03-09T15:33:13.559 WARNING:teuthology.misc:Removing root device: /dev/vda from device list 2026-03-09T15:33:13.559 DEBUG:teuthology.misc:devs=['/dev/vdb', '/dev/vdc', '/dev/vdd', '/dev/vde'] 2026-03-09T15:33:13.559 DEBUG:teuthology.orchestra.run.vm04:> stat /dev/vdb 2026-03-09T15:33:13.622 INFO:teuthology.orchestra.run.vm04.stdout: File: /dev/vdb 2026-03-09T15:33:13.622 INFO:teuthology.orchestra.run.vm04.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T15:33:13.622 INFO:teuthology.orchestra.run.vm04.stdout:Device: 6h/6d Inode: 221 Links: 1 Device type: fc,10 2026-03-09T15:33:13.622 INFO:teuthology.orchestra.run.vm04.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T15:33:13.622 INFO:teuthology.orchestra.run.vm04.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T15:33:13.622 INFO:teuthology.orchestra.run.vm04.stdout:Access: 2026-03-09 15:33:06.505171260 +0000 2026-03-09T15:33:13.622 INFO:teuthology.orchestra.run.vm04.stdout:Modify: 2026-03-09 15:29:49.477344142 +0000 2026-03-09T15:33:13.622 INFO:teuthology.orchestra.run.vm04.stdout:Change: 2026-03-09 15:29:49.477344142 +0000 2026-03-09T15:33:13.622 INFO:teuthology.orchestra.run.vm04.stdout: Birth: 2026-03-09 15:27:17.287000000 +0000 2026-03-09T15:33:13.623 DEBUG:teuthology.orchestra.run.vm04:> sudo dd if=/dev/vdb of=/dev/null count=1 2026-03-09T15:33:13.692 INFO:teuthology.orchestra.run.vm04.stderr:1+0 records in 2026-03-09T15:33:13.693 INFO:teuthology.orchestra.run.vm04.stderr:1+0 records out 2026-03-09T15:33:13.693 INFO:teuthology.orchestra.run.vm04.stderr:512 bytes copied, 0.000247263 s, 2.1 MB/s 2026-03-09T15:33:13.694 DEBUG:teuthology.orchestra.run.vm04:> ! mount | grep -v devtmpfs | grep -q /dev/vdb 2026-03-09T15:33:13.764 DEBUG:teuthology.orchestra.run.vm04:> stat /dev/vdc 2026-03-09T15:33:13.813 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:13 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:13.508+0000 7f9340f7f140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T15:33:13.840 INFO:teuthology.orchestra.run.vm04.stdout: File: /dev/vdc 2026-03-09T15:33:13.840 INFO:teuthology.orchestra.run.vm04.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T15:33:13.840 INFO:teuthology.orchestra.run.vm04.stdout:Device: 6h/6d Inode: 224 Links: 1 Device type: fc,20 2026-03-09T15:33:13.840 INFO:teuthology.orchestra.run.vm04.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T15:33:13.840 INFO:teuthology.orchestra.run.vm04.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T15:33:13.840 INFO:teuthology.orchestra.run.vm04.stdout:Access: 2026-03-09 15:33:06.510171269 +0000 2026-03-09T15:33:13.840 INFO:teuthology.orchestra.run.vm04.stdout:Modify: 2026-03-09 15:29:49.489344154 +0000 2026-03-09T15:33:13.840 INFO:teuthology.orchestra.run.vm04.stdout:Change: 2026-03-09 15:29:49.489344154 +0000 2026-03-09T15:33:13.840 INFO:teuthology.orchestra.run.vm04.stdout: Birth: 2026-03-09 15:27:17.300000000 +0000 2026-03-09T15:33:13.840 DEBUG:teuthology.orchestra.run.vm04:> sudo dd if=/dev/vdc of=/dev/null count=1 2026-03-09T15:33:13.935 INFO:teuthology.orchestra.run.vm04.stderr:1+0 records in 2026-03-09T15:33:13.935 INFO:teuthology.orchestra.run.vm04.stderr:1+0 records out 2026-03-09T15:33:13.935 INFO:teuthology.orchestra.run.vm04.stderr:512 bytes copied, 0.000381145 s, 1.3 MB/s 2026-03-09T15:33:13.937 DEBUG:teuthology.orchestra.run.vm04:> ! mount | grep -v devtmpfs | grep -q /dev/vdc 2026-03-09T15:33:13.968 DEBUG:teuthology.orchestra.run.vm04:> stat /dev/vdd 2026-03-09T15:33:14.032 INFO:teuthology.orchestra.run.vm04.stdout: File: /dev/vdd 2026-03-09T15:33:14.032 INFO:teuthology.orchestra.run.vm04.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T15:33:14.032 INFO:teuthology.orchestra.run.vm04.stdout:Device: 6h/6d Inode: 225 Links: 1 Device type: fc,30 2026-03-09T15:33:14.032 INFO:teuthology.orchestra.run.vm04.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T15:33:14.032 INFO:teuthology.orchestra.run.vm04.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T15:33:14.032 INFO:teuthology.orchestra.run.vm04.stdout:Access: 2026-03-09 15:33:06.515171277 +0000 2026-03-09T15:33:14.032 INFO:teuthology.orchestra.run.vm04.stdout:Modify: 2026-03-09 15:29:49.495344160 +0000 2026-03-09T15:33:14.032 INFO:teuthology.orchestra.run.vm04.stdout:Change: 2026-03-09 15:29:49.495344160 +0000 2026-03-09T15:33:14.032 INFO:teuthology.orchestra.run.vm04.stdout: Birth: 2026-03-09 15:27:17.308000000 +0000 2026-03-09T15:33:14.032 DEBUG:teuthology.orchestra.run.vm04:> sudo dd if=/dev/vdd of=/dev/null count=1 2026-03-09T15:33:14.122 INFO:teuthology.orchestra.run.vm04.stderr:1+0 records in 2026-03-09T15:33:14.123 INFO:teuthology.orchestra.run.vm04.stderr:1+0 records out 2026-03-09T15:33:14.123 INFO:teuthology.orchestra.run.vm04.stderr:512 bytes copied, 0.00016553 s, 3.1 MB/s 2026-03-09T15:33:14.123 DEBUG:teuthology.orchestra.run.vm04:> ! mount | grep -v devtmpfs | grep -q /dev/vdd 2026-03-09T15:33:14.154 DEBUG:teuthology.orchestra.run.vm04:> stat /dev/vde 2026-03-09T15:33:14.227 INFO:teuthology.orchestra.run.vm04.stdout: File: /dev/vde 2026-03-09T15:33:14.227 INFO:teuthology.orchestra.run.vm04.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T15:33:14.227 INFO:teuthology.orchestra.run.vm04.stdout:Device: 6h/6d Inode: 235 Links: 1 Device type: fc,40 2026-03-09T15:33:14.227 INFO:teuthology.orchestra.run.vm04.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T15:33:14.227 INFO:teuthology.orchestra.run.vm04.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T15:33:14.227 INFO:teuthology.orchestra.run.vm04.stdout:Access: 2026-03-09 15:33:06.519171284 +0000 2026-03-09T15:33:14.227 INFO:teuthology.orchestra.run.vm04.stdout:Modify: 2026-03-09 15:29:49.504344170 +0000 2026-03-09T15:33:14.227 INFO:teuthology.orchestra.run.vm04.stdout:Change: 2026-03-09 15:29:49.504344170 +0000 2026-03-09T15:33:14.227 INFO:teuthology.orchestra.run.vm04.stdout: Birth: 2026-03-09 15:27:17.318000000 +0000 2026-03-09T15:33:14.227 DEBUG:teuthology.orchestra.run.vm04:> sudo dd if=/dev/vde of=/dev/null count=1 2026-03-09T15:33:14.319 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:14.100+0000 7f9340f7f140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T15:33:14.321 INFO:teuthology.orchestra.run.vm04.stderr:1+0 records in 2026-03-09T15:33:14.321 INFO:teuthology.orchestra.run.vm04.stderr:1+0 records out 2026-03-09T15:33:14.321 INFO:teuthology.orchestra.run.vm04.stderr:512 bytes copied, 0.00197735 s, 259 kB/s 2026-03-09T15:33:14.323 DEBUG:teuthology.orchestra.run.vm04:> ! mount | grep -v devtmpfs | grep -q /dev/vde 2026-03-09T15:33:14.352 INFO:tasks.cephadm:Deploying osd.0 on vm03 with /dev/vde... 2026-03-09T15:33:14.353 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- lvm zap /dev/vde 2026-03-09T15:33:14.559 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: Reconfiguring mgr.a (unknown last config time)... 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: Reconfiguring daemon mgr.a on vm03 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:14.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: Reconfiguring mgr.a (unknown last config time)... 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: Reconfiguring daemon mgr.a on vm03 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:14.649 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:14 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:14.896 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:14.757+0000 7f9340f7f140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T15:33:15.220 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T15:33:15.220 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T15:33:15.221 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: from numpy import show_config as show_numpy_config 2026-03-09T15:33:15.221 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:14.903+0000 7f9340f7f140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T15:33:15.221 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:14 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:14.976+0000 7f9340f7f140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T15:33:15.221 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:15.124+0000 7f9340f7f140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T15:33:15.446 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:33:15.465 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph orch daemon add osd vm03:/dev/vde 2026-03-09T15:33:15.647 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:15.903 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-mon[53036]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T15:33:15.903 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-mon[53036]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:15.903 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:15.903 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:15.903 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:15.903 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:15.903 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:15.903 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:15.903 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:15.903 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:15.904 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:15.904 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:15.904 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:15.904 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:15.723+0000 7f9340f7f140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T15:33:15.904 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:15.853+0000 7f9340f7f140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T15:33:15.904 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:15.902+0000 7f9340f7f140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T15:33:16.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:15 vm03 ceph-mon[52731]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T15:33:16.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:15 vm03 ceph-mon[52731]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:16.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:15 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:16.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:15 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:16.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:15 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:16.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:15 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:16.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:15 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:16.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:15 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:16.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:15 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:16.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:15 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:16.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:15 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:16.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:15 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:16.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:15 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:16.240 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:15.944+0000 7f9340f7f140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T15:33:16.240 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:15 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:15.990+0000 7f9340f7f140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T15:33:16.240 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:16 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:16.032+0000 7f9340f7f140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T15:33:16.240 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:16 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:16.239+0000 7f9340f7f140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T15:33:16.577 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:16 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:16.304+0000 7f9340f7f140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T15:33:16.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:16 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T15:33:16.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:16 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T15:33:16.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:16 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:16.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:16 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T15:33:16.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:16 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T15:33:16.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:16 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:16.878 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:16 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:16.575+0000 7f9340f7f140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T15:33:17.252 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:16 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:16.933+0000 7f9340f7f140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T15:33:17.252 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:16 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:16.976+0000 7f9340f7f140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T15:33:17.252 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:17.025+0000 7f9340f7f140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T15:33:17.252 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:17.114+0000 7f9340f7f140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T15:33:17.252 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:17.158+0000 7f9340f7f140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T15:33:17.252 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:17.250+0000 7f9340f7f140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T15:33:17.540 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:17.380+0000 7f9340f7f140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T15:33:17.540 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:17.538+0000 7f9340f7f140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T15:33:17.877 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm03:/dev/vde", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/377123228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "01a0d766-23ef-42be-a5d6-5681d5245aae"}]: dispatch 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/377123228' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "01a0d766-23ef-42be-a5d6-5681d5245aae"}]': finished 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: osdmap e5: 1 total, 0 up, 1 in 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/3812509063' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: Standby manager daemon b started 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: from='mgr.? 192.168.123.104:0/303323241' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: from='mgr.? 192.168.123.104:0/303323241' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: from='mgr.? 192.168.123.104:0/303323241' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-mon[53036]: from='mgr.? 192.168.123.104:0/303323241' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-03-09T15:33:17.878 INFO:journalctl@ceph.mgr.b.vm04.stdout:Mar 09 15:33:17 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-b[54440]: 2026-03-09T15:33:17.584+0000 7f9340f7f140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T15:33:18.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm03:/dev/vde", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:18.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:18.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:18.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:18.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:18.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/377123228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "01a0d766-23ef-42be-a5d6-5681d5245aae"}]: dispatch 2026-03-09T15:33:18.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/377123228' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "01a0d766-23ef-42be-a5d6-5681d5245aae"}]': finished 2026-03-09T15:33:18.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: osdmap e5: 1 total, 0 up, 1 in 2026-03-09T15:33:18.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:18.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/3812509063' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T15:33:18.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: Standby manager daemon b started 2026-03-09T15:33:18.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: from='mgr.? 192.168.123.104:0/303323241' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2026-03-09T15:33:18.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: from='mgr.? 192.168.123.104:0/303323241' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-03-09T15:33:18.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: from='mgr.? 192.168.123.104:0/303323241' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2026-03-09T15:33:18.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:17 vm03 ceph-mon[52731]: from='mgr.? 192.168.123.104:0/303323241' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-03-09T15:33:19.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:18 vm04 ceph-mon[53036]: mgrmap e13: a(active, since 25s), standbys: b 2026-03-09T15:33:19.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:18 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2026-03-09T15:33:19.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:18 vm04 ceph-mon[53036]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:19.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:18 vm03 ceph-mon[52731]: mgrmap e13: a(active, since 25s), standbys: b 2026-03-09T15:33:19.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:18 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2026-03-09T15:33:19.316 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:18 vm03 ceph-mon[52731]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:21.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:21 vm03 ceph-mon[52731]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:21.877 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:21 vm04 ceph-mon[53036]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:22.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:22 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-03-09T15:33:22.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:22 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:22.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:22 vm03 ceph-mon[52731]: Deploying daemon osd.0 on vm03 2026-03-09T15:33:22.877 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:22 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-03-09T15:33:22.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:22 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:22.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:22 vm04 ceph-mon[53036]: Deploying daemon osd.0 on vm03 2026-03-09T15:33:23.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:23 vm03 ceph-mon[52731]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:23.877 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:23 vm04 ceph-mon[53036]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:24.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:24 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:24.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:24 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:24.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:24 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:24.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:24 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:24.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:24 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:24.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:24 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:24.877 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:24 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:24.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:24 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:24.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:24 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:24.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:24 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:24.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:24 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:24.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:24 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:25.105 INFO:teuthology.orchestra.run.vm03.stdout:Created osd(s) 0 on host 'vm03' 2026-03-09T15:33:25.178 DEBUG:teuthology.orchestra.run.vm03:osd.0> sudo journalctl -f -n 0 -u ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@osd.0.service 2026-03-09T15:33:25.180 INFO:tasks.cephadm:Deploying osd.1 on vm04 with /dev/vde... 2026-03-09T15:33:25.180 DEBUG:teuthology.orchestra.run.vm04:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- lvm zap /dev/vde 2026-03-09T15:33:25.374 INFO:teuthology.orchestra.run.vm04.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.b/config 2026-03-09T15:33:25.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:25 vm03 ceph-mon[52731]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:25.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:25 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:25.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:25 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T15:33:25.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:25 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:25.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:25 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:25.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:25 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:25.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:25 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:25.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:25 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:25.831 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:25 vm04 ceph-mon[53036]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:25.831 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:25 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:25.831 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:25 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T15:33:25.831 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:25 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:25.831 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:25 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:25.831 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:25 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:25.831 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:25 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:25.831 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:25 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:26.265 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:33:26.282 DEBUG:teuthology.orchestra.run.vm04:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph orch daemon add osd vm04:/dev/vde 2026-03-09T15:33:26.316 INFO:journalctl@ceph.osd.0.vm03.stdout:Mar 09 15:33:25 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-0[60407]: 2026-03-09T15:33:25.980+0000 7f62169ce740 -1 osd.0 0 log_to_monitors true 2026-03-09T15:33:26.486 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:26 vm04 ceph-mon[53036]: from='osd.0 [v2:192.168.123.103:6802/2683141375,v1:192.168.123.103:6803/2683141375]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T15:33:26.499 INFO:teuthology.orchestra.run.vm04.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.b/config 2026-03-09T15:33:26.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:26 vm03 ceph-mon[52731]: from='osd.0 [v2:192.168.123.103:6802/2683141375,v1:192.168.123.103:6803/2683141375]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T15:33:27.714 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:27 vm04 ceph-mon[53036]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:27.714 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:27 vm04 ceph-mon[53036]: from='osd.0 [v2:192.168.123.103:6802/2683141375,v1:192.168.123.103:6803/2683141375]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]': finished 2026-03-09T15:33:27.714 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:27 vm04 ceph-mon[53036]: osdmap e6: 1 total, 0 up, 1 in 2026-03-09T15:33:27.714 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:27 vm04 ceph-mon[53036]: from='osd.0 [v2:192.168.123.103:6802/2683141375,v1:192.168.123.103:6803/2683141375]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T15:33:27.714 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:27 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:27.714 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:27 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T15:33:27.714 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:27 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T15:33:27.714 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:27 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:27.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:27 vm03 ceph-mon[52731]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:27.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:27 vm03 ceph-mon[52731]: from='osd.0 [v2:192.168.123.103:6802/2683141375,v1:192.168.123.103:6803/2683141375]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]': finished 2026-03-09T15:33:27.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:27 vm03 ceph-mon[52731]: osdmap e6: 1 total, 0 up, 1 in 2026-03-09T15:33:27.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:27 vm03 ceph-mon[52731]: from='osd.0 [v2:192.168.123.103:6802/2683141375,v1:192.168.123.103:6803/2683141375]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T15:33:27.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:27 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:27.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:27 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T15:33:27.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:27 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T15:33:27.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:27 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:28.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:28 vm03 ceph-mon[52731]: from='client.24107 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm04:/dev/vde", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:28.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:28 vm03 ceph-mon[52731]: from='osd.0 [v2:192.168.123.103:6802/2683141375,v1:192.168.123.103:6803/2683141375]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm03", "root=default"]}]': finished 2026-03-09T15:33:28.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:28 vm03 ceph-mon[52731]: osdmap e7: 1 total, 0 up, 1 in 2026-03-09T15:33:28.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:28 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:28.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:28 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:28.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:28 vm03 ceph-mon[52731]: from='client.? 192.168.123.104:0/896996797' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5420a95-6b4d-4707-bee9-8b71d2f67a97"}]: dispatch 2026-03-09T15:33:28.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:28 vm03 ceph-mon[52731]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5420a95-6b4d-4707-bee9-8b71d2f67a97"}]: dispatch 2026-03-09T15:33:28.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:28 vm03 ceph-mon[52731]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5420a95-6b4d-4707-bee9-8b71d2f67a97"}]': finished 2026-03-09T15:33:28.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:28 vm03 ceph-mon[52731]: osdmap e8: 2 total, 0 up, 2 in 2026-03-09T15:33:28.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:28 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:28.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:28 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:28.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:28 vm03 ceph-mon[52731]: from='client.? 192.168.123.104:0/1448174595' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T15:33:28.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:28 vm03 ceph-mon[52731]: from='osd.0 [v2:192.168.123.103:6802/2683141375,v1:192.168.123.103:6803/2683141375]' entity='osd.0' 2026-03-09T15:33:28.817 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:28 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:28.817 INFO:journalctl@ceph.osd.0.vm03.stdout:Mar 09 15:33:28 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-0[60407]: 2026-03-09T15:33:28.428+0000 7f6213162640 -1 osd.0 0 waiting for initial osdmap 2026-03-09T15:33:28.817 INFO:journalctl@ceph.osd.0.vm03.stdout:Mar 09 15:33:28 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-0[60407]: 2026-03-09T15:33:28.436+0000 7f620df78640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T15:33:28.877 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:28 vm04 ceph-mon[53036]: from='client.24107 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm04:/dev/vde", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:28.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:28 vm04 ceph-mon[53036]: from='osd.0 [v2:192.168.123.103:6802/2683141375,v1:192.168.123.103:6803/2683141375]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm03", "root=default"]}]': finished 2026-03-09T15:33:28.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:28 vm04 ceph-mon[53036]: osdmap e7: 1 total, 0 up, 1 in 2026-03-09T15:33:28.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:28 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:28.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:28 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:28.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:28 vm04 ceph-mon[53036]: from='client.? 192.168.123.104:0/896996797' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5420a95-6b4d-4707-bee9-8b71d2f67a97"}]: dispatch 2026-03-09T15:33:28.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:28 vm04 ceph-mon[53036]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5420a95-6b4d-4707-bee9-8b71d2f67a97"}]: dispatch 2026-03-09T15:33:28.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:28 vm04 ceph-mon[53036]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5420a95-6b4d-4707-bee9-8b71d2f67a97"}]': finished 2026-03-09T15:33:28.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:28 vm04 ceph-mon[53036]: osdmap e8: 2 total, 0 up, 2 in 2026-03-09T15:33:28.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:28 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:28.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:28 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:28.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:28 vm04 ceph-mon[53036]: from='client.? 192.168.123.104:0/1448174595' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T15:33:28.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:28 vm04 ceph-mon[53036]: from='osd.0 [v2:192.168.123.103:6802/2683141375,v1:192.168.123.103:6803/2683141375]' entity='osd.0' 2026-03-09T15:33:28.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:28 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:29.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:29 vm03 ceph-mon[52731]: purged_snaps scrub starts 2026-03-09T15:33:29.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:29 vm03 ceph-mon[52731]: purged_snaps scrub ok 2026-03-09T15:33:29.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:29 vm03 ceph-mon[52731]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:29.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:29 vm04 ceph-mon[53036]: purged_snaps scrub starts 2026-03-09T15:33:29.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:29 vm04 ceph-mon[53036]: purged_snaps scrub ok 2026-03-09T15:33:29.878 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:29 vm04 ceph-mon[53036]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:31.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:30 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:31.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:30 vm03 ceph-mon[52731]: osd.0 [v2:192.168.123.103:6802/2683141375,v1:192.168.123.103:6803/2683141375] boot 2026-03-09T15:33:31.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:30 vm03 ceph-mon[52731]: osdmap e9: 2 total, 1 up, 2 in 2026-03-09T15:33:31.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:30 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:31.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:30 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:31.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:30 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:31.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:30 vm04 ceph-mon[53036]: osd.0 [v2:192.168.123.103:6802/2683141375,v1:192.168.123.103:6803/2683141375] boot 2026-03-09T15:33:31.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:30 vm04 ceph-mon[53036]: osdmap e9: 2 total, 1 up, 2 in 2026-03-09T15:33:31.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:30 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T15:33:31.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:30 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:31.851 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:31 vm04 ceph-mon[53036]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:31.851 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:31 vm04 ceph-mon[53036]: osdmap e10: 2 total, 1 up, 2 in 2026-03-09T15:33:31.851 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:31 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:32.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:31 vm03 ceph-mon[52731]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T15:33:32.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:31 vm03 ceph-mon[52731]: osdmap e10: 2 total, 1 up, 2 in 2026-03-09T15:33:32.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:31 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:32.925 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:32 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-03-09T15:33:32.925 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:32 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:33.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:32 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-03-09T15:33:33.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:32 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:33.693 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:33 vm04 ceph-mon[53036]: pgmap v20: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T15:33:33.693 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:33 vm04 ceph-mon[53036]: Deploying daemon osd.1 on vm04 2026-03-09T15:33:34.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:33 vm03 ceph-mon[52731]: pgmap v20: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T15:33:34.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:33 vm03 ceph-mon[52731]: Deploying daemon osd.1 on vm04 2026-03-09T15:33:34.978 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:34 vm04 ceph-mon[53036]: pgmap v21: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T15:33:35.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:34 vm03 ceph-mon[52731]: pgmap v21: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T15:33:35.807 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:35 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:35.807 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:35 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:35.807 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:35 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:35.807 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:35 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:35.807 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:35 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:35.807 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:35 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:35.807 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:35 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:35.807 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:35 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:35.807 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:35 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:35.807 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:35 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:35.807 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:35 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:35.807 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:35 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:35.807 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:35 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:36.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:35 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:36.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:35 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:36.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:35 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:36.066 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:35 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:36.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:35 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:36.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:35 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:36.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:35 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:36.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:35 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:36.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:35 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:36.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:35 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:36.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:35 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:36.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:35 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:36.067 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:35 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:36.553 INFO:teuthology.orchestra.run.vm04.stdout:Created osd(s) 1 on host 'vm04' 2026-03-09T15:33:36.642 DEBUG:teuthology.orchestra.run.vm04:osd.1> sudo journalctl -f -n 0 -u ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@osd.1.service 2026-03-09T15:33:36.643 INFO:tasks.cephadm:Waiting for 2 OSDs to come up... 2026-03-09T15:33:36.643 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph osd stat -f json 2026-03-09T15:33:36.895 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:37.199 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:33:37.292 INFO:teuthology.orchestra.run.vm03.stdout:{"epoch":10,"num_osds":2,"num_up_osds":1,"osd_up_since":1773070409,"num_in_osds":2,"osd_in_since":1773070407,"num_remapped_pgs":0} 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: Detected new or changed devices on vm04 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='osd.1 [v2:192.168.123.104:6800/4283681093,v1:192.168.123.104:6801/4283681093]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:vm04", "name": "osd_memory_target"}]: dispatch 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:37.498 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.499 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:37.499 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.499 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:37 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/3227819068' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T15:33:37.627 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T15:33:37.627 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.627 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.627 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: Detected new or changed devices on vm04 2026-03-09T15:33:37.627 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='osd.1 [v2:192.168.123.104:6800/4283681093,v1:192.168.123.104:6801/4283681093]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:vm04", "name": "osd_memory_target"}]: dispatch 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:37.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:37 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/3227819068' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T15:33:38.255 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:38 vm03 ceph-mon[52731]: Detected new or changed devices on vm03 2026-03-09T15:33:38.293 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph osd stat -f json 2026-03-09T15:33:38.515 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:38 vm03 ceph-mon[52731]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]': finished 2026-03-09T15:33:38.515 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:38 vm03 ceph-mon[52731]: from='osd.1 [v2:192.168.123.104:6800/4283681093,v1:192.168.123.104:6801/4283681093]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm04", "root=default"]}]: dispatch 2026-03-09T15:33:38.515 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:38 vm03 ceph-mon[52731]: osdmap e11: 2 total, 1 up, 2 in 2026-03-09T15:33:38.515 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:38 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:38.515 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:38 vm03 ceph-mon[52731]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm04", "root=default"]}]: dispatch 2026-03-09T15:33:38.515 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:38 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:38.515 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:38 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:38.515 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:38 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:38.515 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:38 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:38.515 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:38 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:38.515 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:38 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:38.515 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:38 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:38.542 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:38.627 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:38 vm04 ceph-mon[53036]: Detected new or changed devices on vm03 2026-03-09T15:33:38.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:38 vm04 ceph-mon[53036]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]': finished 2026-03-09T15:33:38.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:38 vm04 ceph-mon[53036]: from='osd.1 [v2:192.168.123.104:6800/4283681093,v1:192.168.123.104:6801/4283681093]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm04", "root=default"]}]: dispatch 2026-03-09T15:33:38.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:38 vm04 ceph-mon[53036]: osdmap e11: 2 total, 1 up, 2 in 2026-03-09T15:33:38.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:38 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:38.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:38 vm04 ceph-mon[53036]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm04", "root=default"]}]: dispatch 2026-03-09T15:33:38.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:38 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:38.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:38 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:38.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:38 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T15:33:38.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:38 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:38.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:38 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T15:33:38.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:38 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T15:33:38.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:38 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' 2026-03-09T15:33:38.834 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:33:38.904 INFO:teuthology.orchestra.run.vm03.stdout:{"epoch":12,"num_osds":2,"num_up_osds":1,"osd_up_since":1773070409,"num_in_osds":2,"osd_in_since":1773070407,"num_remapped_pgs":0} 2026-03-09T15:33:39.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:39 vm03 ceph-mon[52731]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T15:33:39.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:39 vm03 ceph-mon[52731]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm04", "root=default"]}]': finished 2026-03-09T15:33:39.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:39 vm03 ceph-mon[52731]: osdmap e12: 2 total, 1 up, 2 in 2026-03-09T15:33:39.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:39 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:39.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:39 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:39.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:39 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/2069103514' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T15:33:39.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:39 vm03 ceph-mon[52731]: from='osd.1 ' entity='osd.1' 2026-03-09T15:33:39.628 INFO:journalctl@ceph.osd.1.vm04.stdout:Mar 09 15:33:39 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-1[57328]: 2026-03-09T15:33:39.151+0000 7f7798185640 -1 osd.1 0 waiting for initial osdmap 2026-03-09T15:33:39.628 INFO:journalctl@ceph.osd.1.vm04.stdout:Mar 09 15:33:39 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-1[57328]: 2026-03-09T15:33:39.156+0000 7f7792f9b640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T15:33:39.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:39 vm04 ceph-mon[53036]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T15:33:39.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:39 vm04 ceph-mon[53036]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm04", "root=default"]}]': finished 2026-03-09T15:33:39.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:39 vm04 ceph-mon[53036]: osdmap e12: 2 total, 1 up, 2 in 2026-03-09T15:33:39.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:39 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:39.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:39 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:39.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:39 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/2069103514' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T15:33:39.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:39 vm04 ceph-mon[53036]: from='osd.1 ' entity='osd.1' 2026-03-09T15:33:39.905 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph osd stat -f json 2026-03-09T15:33:40.099 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:40.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:40 vm03 ceph-mon[52731]: purged_snaps scrub starts 2026-03-09T15:33:40.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:40 vm03 ceph-mon[52731]: purged_snaps scrub ok 2026-03-09T15:33:40.567 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:40 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:40.596 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:33:40.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:40 vm04 ceph-mon[53036]: purged_snaps scrub starts 2026-03-09T15:33:40.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:40 vm04 ceph-mon[53036]: purged_snaps scrub ok 2026-03-09T15:33:40.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:40 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:40.663 INFO:teuthology.orchestra.run.vm03.stdout:{"epoch":13,"num_osds":2,"num_up_osds":2,"osd_up_since":1773070420,"num_in_osds":2,"osd_in_since":1773070407,"num_remapped_pgs":0} 2026-03-09T15:33:40.664 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph osd dump --format=json 2026-03-09T15:33:40.846 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:41.094 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:33:41.095 INFO:teuthology.orchestra.run.vm03.stdout:{"epoch":13,"fsid":"f9592f66-1bcc-11f1-9993-3b6a3d16e741","created":"2026-03-09T15:32:28.225736+0000","modified":"2026-03-09T15:33:40.155692+0000","last_up_change":"2026-03-09T15:33:40.155692+0000","last_in_change":"2026-03-09T15:33:27.654453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"01a0d766-23ef-42be-a5d6-5681d5245aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6802","nonce":2683141375},{"type":"v1","addr":"192.168.123.103:6803","nonce":2683141375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6804","nonce":2683141375},{"type":"v1","addr":"192.168.123.103:6805","nonce":2683141375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6808","nonce":2683141375},{"type":"v1","addr":"192.168.123.103:6809","nonce":2683141375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6806","nonce":2683141375},{"type":"v1","addr":"192.168.123.103:6807","nonce":2683141375}]},"public_addr":"192.168.123.103:6803/2683141375","cluster_addr":"192.168.123.103:6805/2683141375","heartbeat_back_addr":"192.168.123.103:6809/2683141375","heartbeat_front_addr":"192.168.123.103:6807/2683141375","state":["exists","up"]},{"osd":1,"uuid":"a5420a95-6b4d-4707-bee9-8b71d2f67a97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.104:6800","nonce":4283681093},{"type":"v1","addr":"192.168.123.104:6801","nonce":4283681093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.104:6802","nonce":4283681093},{"type":"v1","addr":"192.168.123.104:6803","nonce":4283681093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.104:6806","nonce":4283681093},{"type":"v1","addr":"192.168.123.104:6807","nonce":4283681093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.104:6804","nonce":4283681093},{"type":"v1","addr":"192.168.123.104:6805","nonce":4283681093}]},"public_addr":"192.168.123.104:6801/4283681093","cluster_addr":"192.168.123.104:6803/4283681093","heartbeat_back_addr":"192.168.123.104:6807/4283681093","heartbeat_front_addr":"192.168.123.104:6805/4283681093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T15:33:26.947705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.123.103:0/2619992685":"2026-03-10T15:32:52.159315+0000","192.168.123.103:0/3259187234":"2026-03-10T15:32:52.159315+0000","192.168.123.103:0/3739789590":"2026-03-10T15:32:52.159315+0000","192.168.123.103:6800/586512291":"2026-03-10T15:32:40.816899+0000","192.168.123.103:6801/4224925323":"2026-03-10T15:32:52.159315+0000","192.168.123.103:6801/586512291":"2026-03-10T15:32:40.816899+0000","192.168.123.103:0/1165512323":"2026-03-10T15:32:40.816899+0000","192.168.123.103:6800/4224925323":"2026-03-10T15:32:52.159315+0000","192.168.123.103:0/1722716267":"2026-03-10T15:32:40.816899+0000","192.168.123.103:0/1492563479":"2026-03-10T15:32:40.816899+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-09T15:33:41.312 INFO:tasks.cephadm.ceph_manager.ceph:[] 2026-03-09T15:33:41.313 INFO:tasks.cephadm:Setting up client nodes... 2026-03-09T15:33:41.313 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-03-09T15:33:41.498 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:41.541 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:41 vm03 ceph-mon[52731]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T15:33:41.541 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:41 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:41.541 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:41 vm03 ceph-mon[52731]: osd.1 [v2:192.168.123.104:6800/4283681093,v1:192.168.123.104:6801/4283681093] boot 2026-03-09T15:33:41.541 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:41 vm03 ceph-mon[52731]: osdmap e13: 2 total, 2 up, 2 in 2026-03-09T15:33:41.541 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:41 vm03 ceph-mon[52731]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:41.541 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:41 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/2965332038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T15:33:41.541 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:41 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/3886037240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T15:33:41.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:41 vm04 ceph-mon[53036]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T15:33:41.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:41 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:41.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:41 vm04 ceph-mon[53036]: osd.1 [v2:192.168.123.104:6800/4283681093,v1:192.168.123.104:6801/4283681093] boot 2026-03-09T15:33:41.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:41 vm04 ceph-mon[53036]: osdmap e13: 2 total, 2 up, 2 in 2026-03-09T15:33:41.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:41 vm04 ceph-mon[53036]: from='mgr.14150 192.168.123.103:0/394020498' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T15:33:41.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:41 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/2965332038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T15:33:41.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:41 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/3886037240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T15:33:41.800 INFO:teuthology.orchestra.run.vm03.stdout:[client.0] 2026-03-09T15:33:41.800 INFO:teuthology.orchestra.run.vm03.stdout: key = AQBV6K5pGI5aLxAA16/g/HJaXjIXcNyBg2DvCA== 2026-03-09T15:33:41.863 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T15:33:41.863 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-03-09T15:33:41.863 DEBUG:teuthology.orchestra.run.vm03:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-03-09T15:33:41.904 DEBUG:teuthology.orchestra.run.vm04:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-03-09T15:33:42.107 INFO:teuthology.orchestra.run.vm04.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.b/config 2026-03-09T15:33:42.400 INFO:teuthology.orchestra.run.vm04.stdout:[client.1] 2026-03-09T15:33:42.400 INFO:teuthology.orchestra.run.vm04.stdout: key = AQBW6K5pbsl6FxAAUy+R7u18wR1NEnZsuP7qRw== 2026-03-09T15:33:42.439 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:42 vm04 ceph-mon[53036]: osdmap e14: 2 total, 2 up, 2 in 2026-03-09T15:33:42.439 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:42 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/2553956961' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T15:33:42.439 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:42 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/2553956961' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T15:33:42.491 DEBUG:teuthology.orchestra.run.vm04:> set -ex 2026-03-09T15:33:42.491 DEBUG:teuthology.orchestra.run.vm04:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-03-09T15:33:42.491 DEBUG:teuthology.orchestra.run.vm04:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-03-09T15:33:42.540 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-03-09T15:33:42.540 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-03-09T15:33:42.540 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph mgr dump --format=json 2026-03-09T15:33:42.565 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:42 vm03 ceph-mon[52731]: osdmap e14: 2 total, 2 up, 2 in 2026-03-09T15:33:42.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:42 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/2553956961' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T15:33:42.566 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:42 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/2553956961' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T15:33:42.720 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:43.017 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:33:43.119 INFO:teuthology.orchestra.run.vm03.stdout:{"epoch":13,"flags":0,"active_gid":14150,"active_name":"a","active_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6800","nonce":3462160035},{"type":"v1","addr":"192.168.123.103:6801","nonce":3462160035}]},"active_addr":"192.168.123.103:6801/3462160035","active_change":"2026-03-09T15:32:52.159616+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14198,"name":"b","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://192.168.123.103:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"192.168.123.103:0","nonce":1702271108}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"192.168.123.103:0","nonce":28962197}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"192.168.123.103:0","nonce":2810111299}]}]} 2026-03-09T15:33:43.122 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-03-09T15:33:43.122 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-03-09T15:33:43.122 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph osd dump --format=json 2026-03-09T15:33:43.351 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:43.379 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:43 vm03 ceph-mon[52731]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T15:33:43.380 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:43 vm03 ceph-mon[52731]: from='client.? 192.168.123.104:0/4118832859' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T15:33:43.380 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:43 vm03 ceph-mon[52731]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T15:33:43.380 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:43 vm03 ceph-mon[52731]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T15:33:43.380 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:43 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/1611032134' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-03-09T15:33:43.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:43 vm04 ceph-mon[53036]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T15:33:43.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:43 vm04 ceph-mon[53036]: from='client.? 192.168.123.104:0/4118832859' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T15:33:43.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:43 vm04 ceph-mon[53036]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T15:33:43.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:43 vm04 ceph-mon[53036]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T15:33:43.628 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:43 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/1611032134' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-03-09T15:33:43.702 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:33:43.703 INFO:teuthology.orchestra.run.vm03.stdout:{"epoch":14,"fsid":"f9592f66-1bcc-11f1-9993-3b6a3d16e741","created":"2026-03-09T15:32:28.225736+0000","modified":"2026-03-09T15:33:41.301989+0000","last_up_change":"2026-03-09T15:33:40.155692+0000","last_in_change":"2026-03-09T15:33:27.654453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"01a0d766-23ef-42be-a5d6-5681d5245aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6802","nonce":2683141375},{"type":"v1","addr":"192.168.123.103:6803","nonce":2683141375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6804","nonce":2683141375},{"type":"v1","addr":"192.168.123.103:6805","nonce":2683141375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6808","nonce":2683141375},{"type":"v1","addr":"192.168.123.103:6809","nonce":2683141375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6806","nonce":2683141375},{"type":"v1","addr":"192.168.123.103:6807","nonce":2683141375}]},"public_addr":"192.168.123.103:6803/2683141375","cluster_addr":"192.168.123.103:6805/2683141375","heartbeat_back_addr":"192.168.123.103:6809/2683141375","heartbeat_front_addr":"192.168.123.103:6807/2683141375","state":["exists","up"]},{"osd":1,"uuid":"a5420a95-6b4d-4707-bee9-8b71d2f67a97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.104:6800","nonce":4283681093},{"type":"v1","addr":"192.168.123.104:6801","nonce":4283681093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.104:6802","nonce":4283681093},{"type":"v1","addr":"192.168.123.104:6803","nonce":4283681093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.104:6806","nonce":4283681093},{"type":"v1","addr":"192.168.123.104:6807","nonce":4283681093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.104:6804","nonce":4283681093},{"type":"v1","addr":"192.168.123.104:6805","nonce":4283681093}]},"public_addr":"192.168.123.104:6801/4283681093","cluster_addr":"192.168.123.104:6803/4283681093","heartbeat_back_addr":"192.168.123.104:6807/4283681093","heartbeat_front_addr":"192.168.123.104:6805/4283681093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T15:33:26.947705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T15:33:37.465849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.123.103:0/2619992685":"2026-03-10T15:32:52.159315+0000","192.168.123.103:0/3259187234":"2026-03-10T15:32:52.159315+0000","192.168.123.103:0/3739789590":"2026-03-10T15:32:52.159315+0000","192.168.123.103:6800/586512291":"2026-03-10T15:32:40.816899+0000","192.168.123.103:6801/4224925323":"2026-03-10T15:32:52.159315+0000","192.168.123.103:6801/586512291":"2026-03-10T15:32:40.816899+0000","192.168.123.103:0/1165512323":"2026-03-10T15:32:40.816899+0000","192.168.123.103:6800/4224925323":"2026-03-10T15:32:52.159315+0000","192.168.123.103:0/1722716267":"2026-03-10T15:32:40.816899+0000","192.168.123.103:0/1492563479":"2026-03-10T15:32:40.816899+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-09T15:33:43.767 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-03-09T15:33:43.768 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph osd dump --format=json 2026-03-09T15:33:43.989 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:44.325 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:33:44.325 INFO:teuthology.orchestra.run.vm03.stdout:{"epoch":14,"fsid":"f9592f66-1bcc-11f1-9993-3b6a3d16e741","created":"2026-03-09T15:32:28.225736+0000","modified":"2026-03-09T15:33:41.301989+0000","last_up_change":"2026-03-09T15:33:40.155692+0000","last_in_change":"2026-03-09T15:33:27.654453+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"01a0d766-23ef-42be-a5d6-5681d5245aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6802","nonce":2683141375},{"type":"v1","addr":"192.168.123.103:6803","nonce":2683141375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6804","nonce":2683141375},{"type":"v1","addr":"192.168.123.103:6805","nonce":2683141375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6808","nonce":2683141375},{"type":"v1","addr":"192.168.123.103:6809","nonce":2683141375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6806","nonce":2683141375},{"type":"v1","addr":"192.168.123.103:6807","nonce":2683141375}]},"public_addr":"192.168.123.103:6803/2683141375","cluster_addr":"192.168.123.103:6805/2683141375","heartbeat_back_addr":"192.168.123.103:6809/2683141375","heartbeat_front_addr":"192.168.123.103:6807/2683141375","state":["exists","up"]},{"osd":1,"uuid":"a5420a95-6b4d-4707-bee9-8b71d2f67a97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.104:6800","nonce":4283681093},{"type":"v1","addr":"192.168.123.104:6801","nonce":4283681093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.104:6802","nonce":4283681093},{"type":"v1","addr":"192.168.123.104:6803","nonce":4283681093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.104:6806","nonce":4283681093},{"type":"v1","addr":"192.168.123.104:6807","nonce":4283681093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.104:6804","nonce":4283681093},{"type":"v1","addr":"192.168.123.104:6805","nonce":4283681093}]},"public_addr":"192.168.123.104:6801/4283681093","cluster_addr":"192.168.123.104:6803/4283681093","heartbeat_back_addr":"192.168.123.104:6807/4283681093","heartbeat_front_addr":"192.168.123.104:6805/4283681093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T15:33:26.947705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T15:33:37.465849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.123.103:0/2619992685":"2026-03-10T15:32:52.159315+0000","192.168.123.103:0/3259187234":"2026-03-10T15:32:52.159315+0000","192.168.123.103:0/3739789590":"2026-03-10T15:32:52.159315+0000","192.168.123.103:6800/586512291":"2026-03-10T15:32:40.816899+0000","192.168.123.103:6801/4224925323":"2026-03-10T15:32:52.159315+0000","192.168.123.103:6801/586512291":"2026-03-10T15:32:40.816899+0000","192.168.123.103:0/1165512323":"2026-03-10T15:32:40.816899+0000","192.168.123.103:6800/4224925323":"2026-03-10T15:32:52.159315+0000","192.168.123.103:0/1722716267":"2026-03-10T15:32:40.816899+0000","192.168.123.103:0/1492563479":"2026-03-10T15:32:40.816899+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-09T15:33:44.380 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph tell osd.0 flush_pg_stats 2026-03-09T15:33:44.380 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph tell osd.1 flush_pg_stats 2026-03-09T15:33:44.593 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:44.596 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:44.626 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:44 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/674102268' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T15:33:44.627 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:44 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/674102268' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T15:33:44.855 INFO:teuthology.orchestra.run.vm03.stdout:55834574850 2026-03-09T15:33:44.855 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph osd last-stat-seq osd.1 2026-03-09T15:33:44.921 INFO:teuthology.orchestra.run.vm03.stdout:38654705668 2026-03-09T15:33:44.921 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph osd last-stat-seq osd.0 2026-03-09T15:33:45.106 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:45.161 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:45.429 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:45 vm03 ceph-mon[52731]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T15:33:45.430 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:45 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/1908600933' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T15:33:45.430 INFO:teuthology.orchestra.run.vm03.stdout:55834574849 2026-03-09T15:33:45.463 INFO:teuthology.orchestra.run.vm03.stdout:38654705667 2026-03-09T15:33:45.498 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.1 2026-03-09T15:33:45.533 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2026-03-09T15:33:45.627 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:45 vm04 ceph-mon[53036]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T15:33:45.627 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:45 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/1908600933' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T15:33:46.499 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph osd last-stat-seq osd.1 2026-03-09T15:33:46.534 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph osd last-stat-seq osd.0 2026-03-09T15:33:46.703 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:46.796 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:46 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/1424601756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-03-09T15:33:46.796 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:46 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/2421548153' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-03-09T15:33:46.964 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:47.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:46 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/1424601756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-03-09T15:33:47.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:46 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/2421548153' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-03-09T15:33:47.159 INFO:teuthology.orchestra.run.vm03.stdout:55834574850 2026-03-09T15:33:47.244 INFO:teuthology.orchestra.run.vm03.stdout:38654705669 2026-03-09T15:33:47.259 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.1 2026-03-09T15:33:47.259 DEBUG:teuthology.parallel:result is None 2026-03-09T15:33:47.313 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705668 got 38654705669 for osd.0 2026-03-09T15:33:47.313 DEBUG:teuthology.parallel:result is None 2026-03-09T15:33:47.313 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-03-09T15:33:47.313 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph pg dump --format=json 2026-03-09T15:33:47.510 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:47.770 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:33:47.771 INFO:teuthology.orchestra.run.vm03.stderr:dumped all 2026-03-09T15:33:47.847 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:47 vm03 ceph-mon[52731]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T15:33:47.847 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:47 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/1930018968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-03-09T15:33:47.847 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:47 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/4252511734' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-03-09T15:33:47.847 INFO:teuthology.orchestra.run.vm03.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2026-03-09T15:33:46.200283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":0,"kb":41934848,"kb_used":53924,"kb_used_data":240,"kb_used_omap":3,"kb_used_meta":53628,"kb_avail":41880924,"statfs":{"total":42941284352,"available":42886066176,"internally_reserved":0,"allocated":245760,"data_stored":60048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3180,"internal_metadata":54915988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":20967424,"kb_used":26960,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940464,"statfs":{"total":21470642176,"available":21443035136,"internally_reserved":0,"allocated":122880,"data_stored":30024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":20967424,"kb_used":26964,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940460,"statfs":{"total":21470642176,"available":21443031040,"internally_reserved":0,"allocated":122880,"data_stored":30024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-03-09T15:33:47.847 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph pg dump --format=json 2026-03-09T15:33:48.064 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:48.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:47 vm04 ceph-mon[53036]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T15:33:48.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:47 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/1930018968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-03-09T15:33:48.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:47 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/4252511734' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-03-09T15:33:48.436 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:33:48.436 INFO:teuthology.orchestra.run.vm03.stderr:dumped all 2026-03-09T15:33:48.503 INFO:teuthology.orchestra.run.vm03.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2026-03-09T15:33:48.200630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":0,"kb":41934848,"kb_used":53924,"kb_used_data":240,"kb_used_omap":3,"kb_used_meta":53628,"kb_avail":41880924,"statfs":{"total":42941284352,"available":42886066176,"internally_reserved":0,"allocated":245760,"data_stored":60048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3180,"internal_metadata":54915988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":20967424,"kb_used":26960,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940464,"statfs":{"total":21470642176,"available":21443035136,"internally_reserved":0,"allocated":122880,"data_stored":30024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":20967424,"kb_used":26964,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20940460,"statfs":{"total":21470642176,"available":21443031040,"internally_reserved":0,"allocated":122880,"data_stored":30024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-03-09T15:33:48.503 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-03-09T15:33:48.503 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-03-09T15:33:48.503 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-03-09T15:33:48.503 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph health --format=json 2026-03-09T15:33:48.693 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:48.708 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:48 vm03 ceph-mon[52731]: from='client.14288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T15:33:48.976 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:33:48.976 INFO:teuthology.orchestra.run.vm03.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-03-09T15:33:48.976 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:48 vm03 ceph-mon[52731]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T15:33:48.976 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:48 vm03 ceph-mon[52731]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T15:33:49.030 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-03-09T15:33:49.031 INFO:tasks.cephadm:Setup complete, yielding 2026-03-09T15:33:49.031 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-03-09T15:33:49.034 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@vm03.local 2026-03-09T15:33:49.034 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- bash -c 'set -ex 2026-03-09T15:33:49.034 DEBUG:teuthology.orchestra.run.vm03:> HOSTNAMES=$(ceph orch host ls --format json | jq -r '"'"'.[] | .hostname'"'"') 2026-03-09T15:33:49.034 DEBUG:teuthology.orchestra.run.vm03:> for host in $HOSTNAMES; do 2026-03-09T15:33:49.034 DEBUG:teuthology.orchestra.run.vm03:> # do a check-host on each host to make sure it'"'"'s reachable 2026-03-09T15:33:49.034 DEBUG:teuthology.orchestra.run.vm03:> ceph cephadm check-host ${host} 2> ${host}-ok.txt 2026-03-09T15:33:49.034 DEBUG:teuthology.orchestra.run.vm03:> HOST_OK=$(cat ${host}-ok.txt) 2026-03-09T15:33:49.034 DEBUG:teuthology.orchestra.run.vm03:> if ! grep -q "Host looks OK" <<< "$HOST_OK"; then 2026-03-09T15:33:49.034 DEBUG:teuthology.orchestra.run.vm03:> printf "Failed host check:\n\n$HOST_OK" 2026-03-09T15:33:49.034 DEBUG:teuthology.orchestra.run.vm03:> exit 1 2026-03-09T15:33:49.034 DEBUG:teuthology.orchestra.run.vm03:> fi 2026-03-09T15:33:49.034 DEBUG:teuthology.orchestra.run.vm03:> done 2026-03-09T15:33:49.034 DEBUG:teuthology.orchestra.run.vm03:> ' 2026-03-09T15:33:49.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:48 vm04 ceph-mon[53036]: from='client.14288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T15:33:49.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:48 vm04 ceph-mon[53036]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T15:33:49.128 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:48 vm04 ceph-mon[53036]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T15:33:49.222 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:49.318 INFO:teuthology.orchestra.run.vm03.stderr:++ ceph orch host ls --format json 2026-03-09T15:33:49.322 INFO:teuthology.orchestra.run.vm03.stderr:++ jq -r '.[] | .hostname' 2026-03-09T15:33:49.511 INFO:teuthology.orchestra.run.vm03.stderr:+ HOSTNAMES='vm03 2026-03-09T15:33:49.511 INFO:teuthology.orchestra.run.vm03.stderr:vm04' 2026-03-09T15:33:49.511 INFO:teuthology.orchestra.run.vm03.stderr:+ for host in $HOSTNAMES 2026-03-09T15:33:49.511 INFO:teuthology.orchestra.run.vm03.stderr:+ ceph cephadm check-host vm03 2026-03-09T15:33:49.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:49 vm03 ceph-mon[52731]: from='client.? 192.168.123.103:0/1425789251' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-03-09T15:33:49.816 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:49 vm03 ceph-mon[52731]: from='client.14300 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T15:33:49.870 INFO:teuthology.orchestra.run.vm03.stdout:vm03 (None) ok 2026-03-09T15:33:49.881 INFO:teuthology.orchestra.run.vm03.stderr:++ cat vm03-ok.txt 2026-03-09T15:33:49.882 INFO:teuthology.orchestra.run.vm03.stderr:+ HOST_OK='podman (/usr/bin/podman) version 5.8.0 is present 2026-03-09T15:33:49.882 INFO:teuthology.orchestra.run.vm03.stderr:systemctl is present 2026-03-09T15:33:49.882 INFO:teuthology.orchestra.run.vm03.stderr:lvcreate is present 2026-03-09T15:33:49.882 INFO:teuthology.orchestra.run.vm03.stderr:Unit chronyd.service is enabled and running 2026-03-09T15:33:49.882 INFO:teuthology.orchestra.run.vm03.stderr:Hostname "vm03" matches what is expected. 2026-03-09T15:33:49.882 INFO:teuthology.orchestra.run.vm03.stderr:Host looks OK' 2026-03-09T15:33:49.882 INFO:teuthology.orchestra.run.vm03.stderr:+ grep -q 'Host looks OK' 2026-03-09T15:33:49.883 INFO:teuthology.orchestra.run.vm03.stderr:+ for host in $HOSTNAMES 2026-03-09T15:33:49.883 INFO:teuthology.orchestra.run.vm03.stderr:+ ceph cephadm check-host vm04 2026-03-09T15:33:50.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:49 vm04 ceph-mon[53036]: from='client.? 192.168.123.103:0/1425789251' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-03-09T15:33:50.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:49 vm04 ceph-mon[53036]: from='client.14300 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T15:33:50.234 INFO:teuthology.orchestra.run.vm03.stdout:vm04 (None) ok 2026-03-09T15:33:50.245 INFO:teuthology.orchestra.run.vm03.stderr:++ cat vm04-ok.txt 2026-03-09T15:33:50.247 INFO:teuthology.orchestra.run.vm03.stderr:+ HOST_OK='podman (/usr/bin/podman) version 5.8.0 is present 2026-03-09T15:33:50.247 INFO:teuthology.orchestra.run.vm03.stderr:systemctl is present 2026-03-09T15:33:50.247 INFO:teuthology.orchestra.run.vm03.stderr:lvcreate is present 2026-03-09T15:33:50.247 INFO:teuthology.orchestra.run.vm03.stderr:Unit chronyd.service is enabled and running 2026-03-09T15:33:50.247 INFO:teuthology.orchestra.run.vm03.stderr:Hostname "vm04" matches what is expected. 2026-03-09T15:33:50.247 INFO:teuthology.orchestra.run.vm03.stderr:Host looks OK' 2026-03-09T15:33:50.247 INFO:teuthology.orchestra.run.vm03.stderr:+ grep -q 'Host looks OK' 2026-03-09T15:33:50.305 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-03-09T15:33:50.308 INFO:tasks.cephadm:Teardown begin 2026-03-09T15:33:50.309 DEBUG:teuthology.orchestra.run.vm03:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-03-09T15:33:50.339 DEBUG:teuthology.orchestra.run.vm04:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-03-09T15:33:50.372 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-03-09T15:33:50.372 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 -- ceph mgr module disable cephadm 2026-03-09T15:33:50.604 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/mon.a/config 2026-03-09T15:33:50.625 INFO:teuthology.orchestra.run.vm03.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-03-09T15:33:50.655 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-03-09T15:33:50.655 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-03-09T15:33:50.655 DEBUG:teuthology.orchestra.run.vm03:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-03-09T15:33:50.675 DEBUG:teuthology.orchestra.run.vm04:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-03-09T15:33:50.691 INFO:tasks.cephadm:Stopping all daemons... 2026-03-09T15:33:50.691 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-03-09T15:33:50.692 DEBUG:teuthology.orchestra.run.vm03:> sudo systemctl stop ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mon.a 2026-03-09T15:33:50.887 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:50 vm03 ceph-mon[52731]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "cephadm check-host", "host": "vm03", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:50.887 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:50 vm03 ceph-mon[52731]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "cephadm check-host", "host": "vm04", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:50.887 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:50 vm03 ceph-mon[52731]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T15:33:50.887 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:50 vm03 systemd[1]: Stopping Ceph mon.a for f9592f66-1bcc-11f1-9993-3b6a3d16e741... 2026-03-09T15:33:50.887 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:50 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a[52727]: 2026-03-09T15:33:50.845+0000 7f01f2705640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T15:33:50.887 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:50 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a[52727]: 2026-03-09T15:33:50.845+0000 7f01f2705640 -1 mon.a@0(leader) e2 *** Got Signal Terminated *** 2026-03-09T15:33:51.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:50 vm04 ceph-mon[53036]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "cephadm check-host", "host": "vm03", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:51.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:50 vm04 ceph-mon[53036]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "cephadm check-host", "host": "vm04", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T15:33:51.127 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:50 vm04 ceph-mon[53036]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T15:33:51.165 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:50 vm03 podman[63623]: 2026-03-09 15:33:50.886219903 +0000 UTC m=+0.056429986 container died c669fc41496b115fa190dd4471bebe9a17f970b45440e80170fc1e978a679977 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_REF=squid, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-03-09T15:33:51.165 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:51 vm03 podman[63623]: 2026-03-09 15:33:51.101445805 +0000 UTC m=+0.271655888 container remove c669fc41496b115fa190dd4471bebe9a17f970b45440e80170fc1e978a679977 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, ceph=True, org.label-schema.vendor=CentOS, CEPH_REF=squid, org.label-schema.schema-version=1.0, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df) 2026-03-09T15:33:51.165 INFO:journalctl@ceph.mon.a.vm03.stdout:Mar 09 15:33:51 vm03 bash[63623]: ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-a 2026-03-09T15:33:51.177 DEBUG:teuthology.orchestra.run.vm03:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mon.a.service' 2026-03-09T15:33:51.227 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T15:33:51.227 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-03-09T15:33:51.227 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2026-03-09T15:33:51.227 DEBUG:teuthology.orchestra.run.vm04:> sudo systemctl stop ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mon.b 2026-03-09T15:33:51.508 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:51 vm04 systemd[1]: Stopping Ceph mon.b for f9592f66-1bcc-11f1-9993-3b6a3d16e741... 2026-03-09T15:33:51.508 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:51 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-b[53032]: 2026-03-09T15:33:51.335+0000 7f356a080640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T15:33:51.508 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:51 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-b[53032]: 2026-03-09T15:33:51.335+0000 7f356a080640 -1 mon.b@1(peon) e2 *** Got Signal Terminated *** 2026-03-09T15:33:51.508 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:51 vm04 podman[58735]: 2026-03-09 15:33:51.488766796 +0000 UTC m=+0.166614922 container died e4f9adf920cb679cd2a00c4bd8090432ff900e7e625fae38202ebd31b083d87f (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.license=GPLv2) 2026-03-09T15:33:51.508 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:51 vm04 podman[58735]: 2026-03-09 15:33:51.504273695 +0000 UTC m=+0.182121821 container remove e4f9adf920cb679cd2a00c4bd8090432ff900e7e625fae38202ebd31b083d87f (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-b, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_REF=squid, org.label-schema.build-date=20260223, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2026-03-09T15:33:51.508 INFO:journalctl@ceph.mon.b.vm04.stdout:Mar 09 15:33:51 vm04 bash[58735]: ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mon-b 2026-03-09T15:33:51.576 DEBUG:teuthology.orchestra.run.vm04:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mon.b.service' 2026-03-09T15:33:51.615 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T15:33:51.615 INFO:tasks.cephadm.mon.b:Stopped mon.b 2026-03-09T15:33:51.615 INFO:tasks.cephadm.mgr.a:Stopping mgr.a... 2026-03-09T15:33:51.615 DEBUG:teuthology.orchestra.run.vm03:> sudo systemctl stop ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mgr.a 2026-03-09T15:33:51.873 DEBUG:teuthology.orchestra.run.vm03:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mgr.a.service' 2026-03-09T15:33:51.898 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:33:51 vm03 systemd[1]: Stopping Ceph mgr.a for f9592f66-1bcc-11f1-9993-3b6a3d16e741... 2026-03-09T15:33:51.898 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:33:51 vm03 podman[63728]: 2026-03-09 15:33:51.779949596 +0000 UTC m=+0.070624846 container died e51bdd23e9e64e04cee8b62efa0dea96ed36dd3c5555eafda011c60cbe2d4bba (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a, org.label-schema.vendor=CentOS, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-03-09T15:33:51.898 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:33:51 vm03 podman[63728]: 2026-03-09 15:33:51.808235476 +0000 UTC m=+0.098910726 container remove e51bdd23e9e64e04cee8b62efa0dea96ed36dd3c5555eafda011c60cbe2d4bba (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a, OSD_FLAVOR=default, org.label-schema.build-date=20260223, CEPH_REF=squid, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.schema-version=1.0, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team ) 2026-03-09T15:33:51.898 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:33:51 vm03 bash[63728]: ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-mgr-a 2026-03-09T15:33:51.898 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:33:51 vm03 systemd[1]: ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mgr.a.service: Deactivated successfully. 2026-03-09T15:33:51.898 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:33:51 vm03 systemd[1]: Stopped Ceph mgr.a for f9592f66-1bcc-11f1-9993-3b6a3d16e741. 2026-03-09T15:33:51.898 INFO:journalctl@ceph.mgr.a.vm03.stdout:Mar 09 15:33:51 vm03 systemd[1]: ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mgr.a.service: Consumed 18.913s CPU time. 2026-03-09T15:33:51.917 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T15:33:51.917 INFO:tasks.cephadm.mgr.a:Stopped mgr.a 2026-03-09T15:33:51.917 INFO:tasks.cephadm.mgr.b:Stopping mgr.b... 2026-03-09T15:33:51.917 DEBUG:teuthology.orchestra.run.vm04:> sudo systemctl stop ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mgr.b 2026-03-09T15:33:52.163 DEBUG:teuthology.orchestra.run.vm04:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@mgr.b.service' 2026-03-09T15:33:52.200 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T15:33:52.200 INFO:tasks.cephadm.mgr.b:Stopped mgr.b 2026-03-09T15:33:52.200 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-03-09T15:33:52.200 DEBUG:teuthology.orchestra.run.vm03:> sudo systemctl stop ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@osd.0 2026-03-09T15:33:52.566 INFO:journalctl@ceph.osd.0.vm03.stdout:Mar 09 15:33:52 vm03 systemd[1]: Stopping Ceph osd.0 for f9592f66-1bcc-11f1-9993-3b6a3d16e741... 2026-03-09T15:33:52.566 INFO:journalctl@ceph.osd.0.vm03.stdout:Mar 09 15:33:52 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-0[60407]: 2026-03-09T15:33:52.308+0000 7f6213963640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T15:33:52.566 INFO:journalctl@ceph.osd.0.vm03.stdout:Mar 09 15:33:52 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-0[60407]: 2026-03-09T15:33:52.308+0000 7f6213963640 -1 osd.0 14 *** Got signal Terminated *** 2026-03-09T15:33:52.566 INFO:journalctl@ceph.osd.0.vm03.stdout:Mar 09 15:33:52 vm03 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-0[60407]: 2026-03-09T15:33:52.308+0000 7f6213963640 -1 osd.0 14 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-03-09T15:33:57.359 INFO:journalctl@ceph.osd.0.vm03.stdout:Mar 09 15:33:57 vm03 podman[63831]: 2026-03-09 15:33:57.335207693 +0000 UTC m=+5.043745935 container died 070b47524f46c7d6d02ede89cd64d6d94fc76cf473a9127e43617c021fe5c769 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, CEPH_REF=squid, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3) 2026-03-09T15:33:57.624 INFO:journalctl@ceph.osd.0.vm03.stdout:Mar 09 15:33:57 vm03 podman[63831]: 2026-03-09 15:33:57.358576385 +0000 UTC m=+5.067114617 container remove 070b47524f46c7d6d02ede89cd64d6d94fc76cf473a9127e43617c021fe5c769 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-0, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, ceph=True, CEPH_REF=squid, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0) 2026-03-09T15:33:57.624 INFO:journalctl@ceph.osd.0.vm03.stdout:Mar 09 15:33:57 vm03 bash[63831]: ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-0 2026-03-09T15:33:57.624 INFO:journalctl@ceph.osd.0.vm03.stdout:Mar 09 15:33:57 vm03 podman[64034]: 2026-03-09 15:33:57.578189253 +0000 UTC m=+0.045747961 container create 3503df8c84fce62ca66c89fd463aa867c31d712bf735ffd7ce070c5b40acbda9 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-0-deactivate, CEPH_REF=squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, ceph=True, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3) 2026-03-09T15:33:57.821 DEBUG:teuthology.orchestra.run.vm03:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@osd.0.service' 2026-03-09T15:33:57.874 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T15:33:57.874 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-03-09T15:33:57.874 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-03-09T15:33:57.874 DEBUG:teuthology.orchestra.run.vm04:> sudo systemctl stop ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@osd.1 2026-03-09T15:33:58.378 INFO:journalctl@ceph.osd.1.vm04.stdout:Mar 09 15:33:57 vm04 systemd[1]: Stopping Ceph osd.1 for f9592f66-1bcc-11f1-9993-3b6a3d16e741... 2026-03-09T15:33:58.378 INFO:journalctl@ceph.osd.1.vm04.stdout:Mar 09 15:33:57 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-1[57328]: 2026-03-09T15:33:57.998+0000 7f7798986640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T15:33:58.378 INFO:journalctl@ceph.osd.1.vm04.stdout:Mar 09 15:33:57 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-1[57328]: 2026-03-09T15:33:57.998+0000 7f7798986640 -1 osd.1 14 *** Got signal Terminated *** 2026-03-09T15:33:58.378 INFO:journalctl@ceph.osd.1.vm04.stdout:Mar 09 15:33:57 vm04 ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-1[57328]: 2026-03-09T15:33:57.998+0000 7f7798986640 -1 osd.1 14 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-03-09T15:34:03.286 INFO:journalctl@ceph.osd.1.vm04.stdout:Mar 09 15:34:03 vm04 podman[59246]: 2026-03-09 15:34:03.028421858 +0000 UTC m=+5.047988912 container died 2eb5545657b44b65d0a84c19f66d446ffc19ea189404aa5502061634e89e9207 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-1, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.vendor=CentOS, CEPH_REF=squid, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223) 2026-03-09T15:34:03.286 INFO:journalctl@ceph.osd.1.vm04.stdout:Mar 09 15:34:03 vm04 podman[59246]: 2026-03-09 15:34:03.073669375 +0000 UTC m=+5.093236419 container remove 2eb5545657b44b65d0a84c19f66d446ffc19ea189404aa5502061634e89e9207 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-1, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_REF=squid, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default) 2026-03-09T15:34:03.286 INFO:journalctl@ceph.osd.1.vm04.stdout:Mar 09 15:34:03 vm04 bash[59246]: ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-1 2026-03-09T15:34:03.286 INFO:journalctl@ceph.osd.1.vm04.stdout:Mar 09 15:34:03 vm04 podman[59315]: 2026-03-09 15:34:03.246289317 +0000 UTC m=+0.019618118 container create 5c44e48765e39d65af17072f60cb9dd0fea2a324ff2ff5300bb635cd27e630ad (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-1-deactivate, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_REF=squid) 2026-03-09T15:34:03.286 INFO:journalctl@ceph.osd.1.vm04.stdout:Mar 09 15:34:03 vm04 podman[59315]: 2026-03-09 15:34:03.284260179 +0000 UTC m=+0.057588980 container init 5c44e48765e39d65af17072f60cb9dd0fea2a324ff2ff5300bb635cd27e630ad (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741-osd-1-deactivate, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_REF=squid, org.opencontainers.image.authors=Ceph Release Team ) 2026-03-09T15:34:03.493 DEBUG:teuthology.orchestra.run.vm04:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9592f66-1bcc-11f1-9993-3b6a3d16e741@osd.1.service' 2026-03-09T15:34:03.533 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T15:34:03.533 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-03-09T15:34:03.533 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 --force --keep-logs 2026-03-09T15:34:03.673 INFO:teuthology.orchestra.run.vm03.stdout:Deleting cluster with fsid: f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:34:04.863 DEBUG:teuthology.orchestra.run.vm04:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 --force --keep-logs 2026-03-09T15:34:05.010 INFO:teuthology.orchestra.run.vm04.stdout:Deleting cluster with fsid: f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:34:06.139 DEBUG:teuthology.orchestra.run.vm03:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-03-09T15:34:06.170 DEBUG:teuthology.orchestra.run.vm04:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-03-09T15:34:06.199 INFO:tasks.cephadm:Archiving crash dumps... 2026-03-09T15:34:06.199 DEBUG:teuthology.misc:Transferring archived files from vm03:/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/crash to /archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/526/remote/vm03/crash 2026-03-09T15:34:06.199 DEBUG:teuthology.orchestra.run.vm03:> sudo tar c -f - -C /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/crash -- . 2026-03-09T15:34:06.236 INFO:teuthology.orchestra.run.vm03.stderr:tar: /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/crash: Cannot open: No such file or directory 2026-03-09T15:34:06.236 INFO:teuthology.orchestra.run.vm03.stderr:tar: Error is not recoverable: exiting now 2026-03-09T15:34:06.237 DEBUG:teuthology.misc:Transferring archived files from vm04:/var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/crash to /archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/526/remote/vm04/crash 2026-03-09T15:34:06.237 DEBUG:teuthology.orchestra.run.vm04:> sudo tar c -f - -C /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/crash -- . 2026-03-09T15:34:06.266 INFO:teuthology.orchestra.run.vm04.stderr:tar: /var/lib/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/crash: Cannot open: No such file or directory 2026-03-09T15:34:06.266 INFO:teuthology.orchestra.run.vm04.stderr:tar: Error is not recoverable: exiting now 2026-03-09T15:34:06.267 INFO:tasks.cephadm:Checking cluster log for badness... 2026-03-09T15:34:06.267 DEBUG:teuthology.orchestra.run.vm03:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2026-03-09T15:34:06.302 INFO:tasks.cephadm:Compressing logs... 2026-03-09T15:34:06.302 DEBUG:teuthology.orchestra.run.vm03:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-03-09T15:34:06.344 DEBUG:teuthology.orchestra.run.vm04:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-03-09T15:34:06.371 INFO:teuthology.orchestra.run.vm04.stderr:find: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-03-09T15:34:06.371 INFO:teuthology.orchestra.run.vm04.stderr:‘/var/log/rbd-target-api’: No such file or directory 2026-03-09T15:34:06.372 INFO:teuthology.orchestra.run.vm04.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-mon.b.log 2026-03-09T15:34:06.373 INFO:teuthology.orchestra.run.vm03.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-03-09T15:34:06.373 INFO:teuthology.orchestra.run.vm04.stderr: 79.5% -- replaced with /var/log/ceph/cephadm.log.gz 2026-03-09T15:34:06.373 INFO:teuthology.orchestra.run.vm04.stderr:gzip -5 --verbose -- /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-volume.log 2026-03-09T15:34:06.373 INFO:teuthology.orchestra.run.vm04.stderr:/var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.audit.log 2026-03-09T15:34:06.373 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-03-09T15:34:06.374 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-mon.a.log 2026-03-09T15:34:06.376 INFO:teuthology.orchestra.run.vm04.stderr:/var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-volume.log: 95.0% -- replaced with /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-volume.log.gz 2026-03-09T15:34:06.376 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/cephadm.log: 85.4% -- replaced with /var/log/ceph/cephadm.log.gz 2026-03-09T15:34:06.376 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.log 2026-03-09T15:34:06.376 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.audit.log 2026-03-09T15:34:06.377 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-mon.a.log: /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.log: 82.6% -- replaced with /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.log.gz 2026-03-09T15:34:06.378 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-mgr.a.log 2026-03-09T15:34:06.379 INFO:teuthology.orchestra.run.vm04.stderr:gzip -5 --verbose -- /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.log 2026-03-09T15:34:06.379 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.audit.log: 89.7% -- replaced with /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.audit.log.gz 2026-03-09T15:34:06.379 INFO:teuthology.orchestra.run.vm04.stderr:/var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.audit.log: 89.8% -- replaced with /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.audit.log.gz 2026-03-09T15:34:06.380 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.cephadm.log 2026-03-09T15:34:06.380 INFO:teuthology.orchestra.run.vm04.stderr:gzip -5 --verbose -- /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.cephadm.log 2026-03-09T15:34:06.381 INFO:teuthology.orchestra.run.vm04.stderr:/var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.log: 79.7% -- replaced with /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.log.gz 2026-03-09T15:34:06.381 INFO:teuthology.orchestra.run.vm04.stderr:gzip -5 --verbose -- /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-mgr.b.log 2026-03-09T15:34:06.382 INFO:teuthology.orchestra.run.vm04.stderr:/var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.cephadm.log: 74.9% -- replaced with /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.cephadm.log.gz 2026-03-09T15:34:06.382 INFO:teuthology.orchestra.run.vm04.stderr:gzip -5 --verbose -- /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-osd.1.log 2026-03-09T15:34:06.384 INFO:teuthology.orchestra.run.vm04.stderr:/var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-mgr.b.log: 92.3% -- replaced with /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-mon.b.log.gz 2026-03-09T15:34:06.384 INFO:teuthology.orchestra.run.vm04.stderr: 89.9% -- replaced with /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-mgr.b.log.gz 2026-03-09T15:34:06.386 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-mgr.a.log: gzip -5 --verbose -- /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-volume.log 2026-03-09T15:34:06.387 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.cephadm.log: 79.1% -- replaced with /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph.cephadm.log.gz 2026-03-09T15:34:06.390 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-osd.0.log 2026-03-09T15:34:06.391 INFO:teuthology.orchestra.run.vm04.stderr:/var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-osd.1.log: 93.7% -- replaced with /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-osd.1.log.gz 2026-03-09T15:34:06.393 INFO:teuthology.orchestra.run.vm04.stderr: 2026-03-09T15:34:06.393 INFO:teuthology.orchestra.run.vm04.stderr:real 0m0.032s 2026-03-09T15:34:06.393 INFO:teuthology.orchestra.run.vm04.stderr:user 0m0.027s 2026-03-09T15:34:06.393 INFO:teuthology.orchestra.run.vm04.stderr:sys 0m0.020s 2026-03-09T15:34:06.395 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-volume.log: 94.8% -- replaced with /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-volume.log.gz 2026-03-09T15:34:06.407 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-osd.0.log: 88.7% -- replaced with /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-mgr.a.log.gz 2026-03-09T15:34:06.410 INFO:teuthology.orchestra.run.vm03.stderr: 93.8% -- replaced with /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-osd.0.log.gz 2026-03-09T15:34:06.435 INFO:teuthology.orchestra.run.vm03.stderr: 91.6% -- replaced with /var/log/ceph/f9592f66-1bcc-11f1-9993-3b6a3d16e741/ceph-mon.a.log.gz 2026-03-09T15:34:06.437 INFO:teuthology.orchestra.run.vm03.stderr: 2026-03-09T15:34:06.438 INFO:teuthology.orchestra.run.vm03.stderr:real 0m0.076s 2026-03-09T15:34:06.438 INFO:teuthology.orchestra.run.vm03.stderr:user 0m0.094s 2026-03-09T15:34:06.438 INFO:teuthology.orchestra.run.vm03.stderr:sys 0m0.020s 2026-03-09T15:34:06.438 INFO:tasks.cephadm:Archiving logs... 2026-03-09T15:34:06.438 DEBUG:teuthology.misc:Transferring archived files from vm03:/var/log/ceph to /archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/526/remote/vm03/log 2026-03-09T15:34:06.438 DEBUG:teuthology.orchestra.run.vm03:> sudo tar c -f - -C /var/log/ceph -- . 2026-03-09T15:34:06.514 DEBUG:teuthology.misc:Transferring archived files from vm04:/var/log/ceph to /archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/526/remote/vm04/log 2026-03-09T15:34:06.514 DEBUG:teuthology.orchestra.run.vm04:> sudo tar c -f - -C /var/log/ceph -- . 2026-03-09T15:34:06.543 INFO:tasks.cephadm:Removing cluster... 2026-03-09T15:34:06.543 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 --force 2026-03-09T15:34:06.693 INFO:teuthology.orchestra.run.vm03.stdout:Deleting cluster with fsid: f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:34:06.894 DEBUG:teuthology.orchestra.run.vm04:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9592f66-1bcc-11f1-9993-3b6a3d16e741 --force 2026-03-09T15:34:07.030 INFO:teuthology.orchestra.run.vm04.stdout:Deleting cluster with fsid: f9592f66-1bcc-11f1-9993-3b6a3d16e741 2026-03-09T15:34:07.260 INFO:tasks.cephadm:Removing cephadm ... 2026-03-09T15:34:07.260 DEBUG:teuthology.orchestra.run.vm03:> rm -rf /home/ubuntu/cephtest/cephadm 2026-03-09T15:34:07.278 DEBUG:teuthology.orchestra.run.vm04:> rm -rf /home/ubuntu/cephtest/cephadm 2026-03-09T15:34:07.297 INFO:tasks.cephadm:Teardown complete 2026-03-09T15:34:07.297 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-03-09T15:34:07.299 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-03-09T15:34:07.299 DEBUG:teuthology.orchestra.run.vm03:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-03-09T15:34:07.320 DEBUG:teuthology.orchestra.run.vm04:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-03-09T15:34:07.376 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2026-03-09T15:34:07.376 DEBUG:teuthology.orchestra.run.vm03:> 2026-03-09T15:34:07.376 DEBUG:teuthology.orchestra.run.vm03:> for d in ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ; do 2026-03-09T15:34:07.376 DEBUG:teuthology.orchestra.run.vm03:> sudo yum -y remove $d || true 2026-03-09T15:34:07.376 DEBUG:teuthology.orchestra.run.vm03:> done 2026-03-09T15:34:07.385 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2026-03-09T15:34:07.385 DEBUG:teuthology.orchestra.run.vm04:> 2026-03-09T15:34:07.385 DEBUG:teuthology.orchestra.run.vm04:> for d in ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ; do 2026-03-09T15:34:07.385 DEBUG:teuthology.orchestra.run.vm04:> sudo yum -y remove $d || true 2026-03-09T15:34:07.385 DEBUG:teuthology.orchestra.run.vm04:> done 2026-03-09T15:34:07.591 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:07.591 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:07.591 INFO:teuthology.orchestra.run.vm03.stdout: Package Arch Version Repository Size 2026-03-09T15:34:07.591 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:07.591 INFO:teuthology.orchestra.run.vm03.stdout:Removing: 2026-03-09T15:34:07.591 INFO:teuthology.orchestra.run.vm03.stdout: ceph-radosgw x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 39 M 2026-03-09T15:34:07.591 INFO:teuthology.orchestra.run.vm03.stdout:Removing unused dependencies: 2026-03-09T15:34:07.591 INFO:teuthology.orchestra.run.vm03.stdout: mailcap noarch 2.1.49-5.el9 @baseos 78 k 2026-03-09T15:34:07.591 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:07.591 INFO:teuthology.orchestra.run.vm03.stdout:Transaction Summary 2026-03-09T15:34:07.591 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:07.591 INFO:teuthology.orchestra.run.vm03.stdout:Remove 2 Packages 2026-03-09T15:34:07.591 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:07.591 INFO:teuthology.orchestra.run.vm03.stdout:Freed space: 39 M 2026-03-09T15:34:07.592 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction check 2026-03-09T15:34:07.594 INFO:teuthology.orchestra.run.vm03.stdout:Transaction check succeeded. 2026-03-09T15:34:07.594 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction test 2026-03-09T15:34:07.609 INFO:teuthology.orchestra.run.vm03.stdout:Transaction test succeeded. 2026-03-09T15:34:07.610 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction 2026-03-09T15:34:07.618 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:07.619 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:07.619 INFO:teuthology.orchestra.run.vm04.stdout: Package Arch Version Repository Size 2026-03-09T15:34:07.619 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:07.619 INFO:teuthology.orchestra.run.vm04.stdout:Removing: 2026-03-09T15:34:07.619 INFO:teuthology.orchestra.run.vm04.stdout: ceph-radosgw x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 39 M 2026-03-09T15:34:07.619 INFO:teuthology.orchestra.run.vm04.stdout:Removing unused dependencies: 2026-03-09T15:34:07.619 INFO:teuthology.orchestra.run.vm04.stdout: mailcap noarch 2.1.49-5.el9 @baseos 78 k 2026-03-09T15:34:07.619 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:07.619 INFO:teuthology.orchestra.run.vm04.stdout:Transaction Summary 2026-03-09T15:34:07.620 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:07.620 INFO:teuthology.orchestra.run.vm04.stdout:Remove 2 Packages 2026-03-09T15:34:07.620 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:07.620 INFO:teuthology.orchestra.run.vm04.stdout:Freed space: 39 M 2026-03-09T15:34:07.620 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction check 2026-03-09T15:34:07.622 INFO:teuthology.orchestra.run.vm04.stdout:Transaction check succeeded. 2026-03-09T15:34:07.622 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction test 2026-03-09T15:34:07.639 INFO:teuthology.orchestra.run.vm04.stdout:Transaction test succeeded. 2026-03-09T15:34:07.639 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction 2026-03-09T15:34:07.644 INFO:teuthology.orchestra.run.vm03.stdout: Preparing : 1/1 2026-03-09T15:34:07.672 INFO:teuthology.orchestra.run.vm04.stdout: Preparing : 1/1 2026-03-09T15:34:07.678 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 1/2 2026-03-09T15:34:07.678 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:07.678 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-03-09T15:34:07.678 INFO:teuthology.orchestra.run.vm03.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target". 2026-03-09T15:34:07.678 INFO:teuthology.orchestra.run.vm03.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-radosgw.target". 2026-03-09T15:34:07.678 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:07.682 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 1/2 2026-03-09T15:34:07.692 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 1/2 2026-03-09T15:34:07.698 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 1/2 2026-03-09T15:34:07.698 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:07.698 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-03-09T15:34:07.698 INFO:teuthology.orchestra.run.vm04.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target". 2026-03-09T15:34:07.698 INFO:teuthology.orchestra.run.vm04.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-radosgw.target". 2026-03-09T15:34:07.698 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:07.702 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 1/2 2026-03-09T15:34:07.712 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : mailcap-2.1.49-5.el9.noarch 2/2 2026-03-09T15:34:07.750 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 1/2 2026-03-09T15:34:07.782 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : mailcap-2.1.49-5.el9.noarch 2/2 2026-03-09T15:34:07.820 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: mailcap-2.1.49-5.el9.noarch 2/2 2026-03-09T15:34:07.820 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 1/2 2026-03-09T15:34:08.004 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: mailcap-2.1.49-5.el9.noarch 2/2 2026-03-09T15:34:08.004 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 1/2 2026-03-09T15:34:08.025 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 2/2 2026-03-09T15:34:08.025 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:08.025 INFO:teuthology.orchestra.run.vm03.stdout:Removed: 2026-03-09T15:34:08.025 INFO:teuthology.orchestra.run.vm03.stdout: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 mailcap-2.1.49-5.el9.noarch 2026-03-09T15:34:08.025 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:08.025 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:08.060 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 2/2 2026-03-09T15:34:08.060 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:08.060 INFO:teuthology.orchestra.run.vm04.stdout:Removed: 2026-03-09T15:34:08.060 INFO:teuthology.orchestra.run.vm04.stdout: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 mailcap-2.1.49-5.el9.noarch 2026-03-09T15:34:08.060 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:08.060 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:08.229 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout: Package Arch Version Repository Size 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout:Removing: 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout: ceph-test x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 210 M 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout:Removing unused dependencies: 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout: libxslt x86_64 1.1.34-12.el9 @appstream 743 k 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout: socat x86_64 1.7.4.1-8.el9 @appstream 1.1 M 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout: xmlstarlet x86_64 1.6.1-20.el9 @appstream 195 k 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout:Transaction Summary 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout:Remove 4 Packages 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout:Freed space: 212 M 2026-03-09T15:34:08.230 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction check 2026-03-09T15:34:08.233 INFO:teuthology.orchestra.run.vm03.stdout:Transaction check succeeded. 2026-03-09T15:34:08.233 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction test 2026-03-09T15:34:08.256 INFO:teuthology.orchestra.run.vm03.stdout:Transaction test succeeded. 2026-03-09T15:34:08.256 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout: Package Arch Version Repository Size 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout:Removing: 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout: ceph-test x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 210 M 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout:Removing unused dependencies: 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout: libxslt x86_64 1.1.34-12.el9 @appstream 743 k 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout: socat x86_64 1.7.4.1-8.el9 @appstream 1.1 M 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout: xmlstarlet x86_64 1.6.1-20.el9 @appstream 195 k 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout:Transaction Summary 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout:Remove 4 Packages 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout:Freed space: 212 M 2026-03-09T15:34:08.273 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction check 2026-03-09T15:34:08.276 INFO:teuthology.orchestra.run.vm04.stdout:Transaction check succeeded. 2026-03-09T15:34:08.276 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction test 2026-03-09T15:34:08.300 INFO:teuthology.orchestra.run.vm04.stdout:Transaction test succeeded. 2026-03-09T15:34:08.300 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction 2026-03-09T15:34:08.321 INFO:teuthology.orchestra.run.vm03.stdout: Preparing : 1/1 2026-03-09T15:34:08.326 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 1/4 2026-03-09T15:34:08.328 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : xmlstarlet-1.6.1-20.el9.x86_64 2/4 2026-03-09T15:34:08.331 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : libxslt-1.1.34-12.el9.x86_64 3/4 2026-03-09T15:34:08.347 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : socat-1.7.4.1-8.el9.x86_64 4/4 2026-03-09T15:34:08.370 INFO:teuthology.orchestra.run.vm04.stdout: Preparing : 1/1 2026-03-09T15:34:08.376 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 1/4 2026-03-09T15:34:08.378 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : xmlstarlet-1.6.1-20.el9.x86_64 2/4 2026-03-09T15:34:08.381 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : libxslt-1.1.34-12.el9.x86_64 3/4 2026-03-09T15:34:08.397 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : socat-1.7.4.1-8.el9.x86_64 4/4 2026-03-09T15:34:08.424 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: socat-1.7.4.1-8.el9.x86_64 4/4 2026-03-09T15:34:08.424 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 1/4 2026-03-09T15:34:08.424 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 2/4 2026-03-09T15:34:08.424 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 3/4 2026-03-09T15:34:08.462 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: socat-1.7.4.1-8.el9.x86_64 4/4 2026-03-09T15:34:08.462 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 1/4 2026-03-09T15:34:08.462 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 2/4 2026-03-09T15:34:08.462 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 3/4 2026-03-09T15:34:08.470 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2026-03-09T15:34:08.470 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:08.470 INFO:teuthology.orchestra.run.vm03.stdout:Removed: 2026-03-09T15:34:08.470 INFO:teuthology.orchestra.run.vm03.stdout: ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 libxslt-1.1.34-12.el9.x86_64 2026-03-09T15:34:08.470 INFO:teuthology.orchestra.run.vm03.stdout: socat-1.7.4.1-8.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2026-03-09T15:34:08.470 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:08.470 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:08.511 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2026-03-09T15:34:08.511 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:08.511 INFO:teuthology.orchestra.run.vm04.stdout:Removed: 2026-03-09T15:34:08.511 INFO:teuthology.orchestra.run.vm04.stdout: ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 libxslt-1.1.34-12.el9.x86_64 2026-03-09T15:34:08.511 INFO:teuthology.orchestra.run.vm04.stdout: socat-1.7.4.1-8.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2026-03-09T15:34:08.511 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:08.511 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:08.695 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout: Package Arch Version Repository Size 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout:Removing: 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout: ceph x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 0 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout:Removing unused dependencies: 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mds x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 7.5 M 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mon x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 18 M 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout: lua x86_64 5.4.4-4.el9 @appstream 593 k 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout: lua-devel x86_64 5.4.4-4.el9 @crb 49 k 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout: luarocks noarch 3.9.2-5.el9 @epel 692 k 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout: unzip x86_64 6.0-59.el9 @baseos 389 k 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout: zip x86_64 3.0-35.el9 @baseos 724 k 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout:Transaction Summary 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout:Remove 8 Packages 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout:Freed space: 28 M 2026-03-09T15:34:08.696 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction check 2026-03-09T15:34:08.699 INFO:teuthology.orchestra.run.vm03.stdout:Transaction check succeeded. 2026-03-09T15:34:08.699 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction test 2026-03-09T15:34:08.715 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout: Package Arch Version Repository Size 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout:Removing: 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout: ceph x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 0 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout:Removing unused dependencies: 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mds x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 7.5 M 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mon x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 18 M 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout: lua x86_64 5.4.4-4.el9 @appstream 593 k 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout: lua-devel x86_64 5.4.4-4.el9 @crb 49 k 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout: luarocks noarch 3.9.2-5.el9 @epel 692 k 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout: unzip x86_64 6.0-59.el9 @baseos 389 k 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout: zip x86_64 3.0-35.el9 @baseos 724 k 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout:Transaction Summary 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout:Remove 8 Packages 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout:Freed space: 28 M 2026-03-09T15:34:08.716 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction check 2026-03-09T15:34:08.719 INFO:teuthology.orchestra.run.vm04.stdout:Transaction check succeeded. 2026-03-09T15:34:08.719 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction test 2026-03-09T15:34:08.725 INFO:teuthology.orchestra.run.vm03.stdout:Transaction test succeeded. 2026-03-09T15:34:08.726 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction 2026-03-09T15:34:08.741 INFO:teuthology.orchestra.run.vm04.stdout:Transaction test succeeded. 2026-03-09T15:34:08.742 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction 2026-03-09T15:34:08.771 INFO:teuthology.orchestra.run.vm03.stdout: Preparing : 1/1 2026-03-09T15:34:08.777 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 1/8 2026-03-09T15:34:08.781 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : luarocks-3.9.2-5.el9.noarch 2/8 2026-03-09T15:34:08.783 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : lua-devel-5.4.4-4.el9.x86_64 3/8 2026-03-09T15:34:08.784 INFO:teuthology.orchestra.run.vm04.stdout: Preparing : 1/1 2026-03-09T15:34:08.787 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : zip-3.0-35.el9.x86_64 4/8 2026-03-09T15:34:08.789 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 1/8 2026-03-09T15:34:08.790 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : unzip-6.0-59.el9.x86_64 5/8 2026-03-09T15:34:08.792 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : lua-5.4.4-4.el9.x86_64 6/8 2026-03-09T15:34:08.794 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : luarocks-3.9.2-5.el9.noarch 2/8 2026-03-09T15:34:08.795 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : lua-devel-5.4.4-4.el9.x86_64 3/8 2026-03-09T15:34:08.798 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : zip-3.0-35.el9.x86_64 4/8 2026-03-09T15:34:08.801 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : unzip-6.0-59.el9.x86_64 5/8 2026-03-09T15:34:08.803 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : lua-5.4.4-4.el9.x86_64 6/8 2026-03-09T15:34:08.820 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 7/8 2026-03-09T15:34:08.820 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:08.820 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-03-09T15:34:08.820 INFO:teuthology.orchestra.run.vm03.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mds.target". 2026-03-09T15:34:08.820 INFO:teuthology.orchestra.run.vm03.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mds.target". 2026-03-09T15:34:08.820 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:08.820 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 7/8 2026-03-09T15:34:08.821 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 7/8 2026-03-09T15:34:08.821 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:08.821 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-03-09T15:34:08.821 INFO:teuthology.orchestra.run.vm04.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mds.target". 2026-03-09T15:34:08.821 INFO:teuthology.orchestra.run.vm04.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mds.target". 2026-03-09T15:34:08.821 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:08.822 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 7/8 2026-03-09T15:34:08.829 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 7/8 2026-03-09T15:34:08.830 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 7/8 2026-03-09T15:34:08.847 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 8/8 2026-03-09T15:34:08.847 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:08.847 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-03-09T15:34:08.847 INFO:teuthology.orchestra.run.vm04.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mon.target". 2026-03-09T15:34:08.847 INFO:teuthology.orchestra.run.vm04.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mon.target". 2026-03-09T15:34:08.847 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:08.850 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 8/8 2026-03-09T15:34:08.856 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 8/8 2026-03-09T15:34:08.856 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:08.856 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-03-09T15:34:08.856 INFO:teuthology.orchestra.run.vm03.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mon.target". 2026-03-09T15:34:08.856 INFO:teuthology.orchestra.run.vm03.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mon.target". 2026-03-09T15:34:08.856 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:08.857 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 8/8 2026-03-09T15:34:08.943 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 8/8 2026-03-09T15:34:08.944 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 1/8 2026-03-09T15:34:08.944 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 2/8 2026-03-09T15:34:08.944 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 3/8 2026-03-09T15:34:08.944 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : lua-5.4.4-4.el9.x86_64 4/8 2026-03-09T15:34:08.944 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 5/8 2026-03-09T15:34:08.944 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 6/8 2026-03-09T15:34:08.944 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : unzip-6.0-59.el9.x86_64 7/8 2026-03-09T15:34:08.955 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 8/8 2026-03-09T15:34:08.955 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 1/8 2026-03-09T15:34:08.955 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 2/8 2026-03-09T15:34:08.955 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 3/8 2026-03-09T15:34:08.955 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : lua-5.4.4-4.el9.x86_64 4/8 2026-03-09T15:34:08.955 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 5/8 2026-03-09T15:34:08.955 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 6/8 2026-03-09T15:34:08.955 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : unzip-6.0-59.el9.x86_64 7/8 2026-03-09T15:34:09.004 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : zip-3.0-35.el9.x86_64 8/8 2026-03-09T15:34:09.004 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:09.004 INFO:teuthology.orchestra.run.vm04.stdout:Removed: 2026-03-09T15:34:09.004 INFO:teuthology.orchestra.run.vm04.stdout: ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:09.004 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:09.004 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:09.004 INFO:teuthology.orchestra.run.vm04.stdout: lua-5.4.4-4.el9.x86_64 2026-03-09T15:34:09.004 INFO:teuthology.orchestra.run.vm04.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-03-09T15:34:09.004 INFO:teuthology.orchestra.run.vm04.stdout: luarocks-3.9.2-5.el9.noarch 2026-03-09T15:34:09.004 INFO:teuthology.orchestra.run.vm04.stdout: unzip-6.0-59.el9.x86_64 2026-03-09T15:34:09.004 INFO:teuthology.orchestra.run.vm04.stdout: zip-3.0-35.el9.x86_64 2026-03-09T15:34:09.004 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:09.004 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:09.020 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : zip-3.0-35.el9.x86_64 8/8 2026-03-09T15:34:09.020 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:09.020 INFO:teuthology.orchestra.run.vm03.stdout:Removed: 2026-03-09T15:34:09.020 INFO:teuthology.orchestra.run.vm03.stdout: ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:09.020 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:09.020 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:09.020 INFO:teuthology.orchestra.run.vm03.stdout: lua-5.4.4-4.el9.x86_64 2026-03-09T15:34:09.020 INFO:teuthology.orchestra.run.vm03.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-03-09T15:34:09.020 INFO:teuthology.orchestra.run.vm03.stdout: luarocks-3.9.2-5.el9.noarch 2026-03-09T15:34:09.020 INFO:teuthology.orchestra.run.vm03.stdout: unzip-6.0-59.el9.x86_64 2026-03-09T15:34:09.020 INFO:teuthology.orchestra.run.vm03.stdout: zip-3.0-35.el9.x86_64 2026-03-09T15:34:09.020 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:09.020 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:09.234 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:09.239 INFO:teuthology.orchestra.run.vm04.stdout:=========================================================================================== 2026-03-09T15:34:09.239 INFO:teuthology.orchestra.run.vm04.stdout: Package Arch Version Repository Size 2026-03-09T15:34:09.239 INFO:teuthology.orchestra.run.vm04.stdout:=========================================================================================== 2026-03-09T15:34:09.239 INFO:teuthology.orchestra.run.vm04.stdout:Removing: 2026-03-09T15:34:09.239 INFO:teuthology.orchestra.run.vm04.stdout: ceph-base x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 23 M 2026-03-09T15:34:09.239 INFO:teuthology.orchestra.run.vm04.stdout:Removing dependent packages: 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 431 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 3.4 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-cephadm noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 806 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-dashboard noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 88 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 66 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-rook noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 563 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: ceph-osd x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 59 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: ceph-volume noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 1.4 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: rbd-mirror x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 13 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout:Removing unused dependencies: 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: abseil-cpp x86_64 20211102.0-4.el9 @epel 1.9 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: ceph-common x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 85 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: ceph-grafana-dashboards noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 628 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-modules-core noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 1.5 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: ceph-prometheus-alerts noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 52 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: ceph-selinux x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 138 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: cryptsetup x86_64 2.8.1-3.el9 @baseos 770 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: flexiblas x86_64 3.0.4-9.el9 @appstream 68 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 @appstream 11 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 @appstream 39 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: gperftools-libs x86_64 2.9.1-3.el9 @epel 1.4 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: grpc-data noarch 1.46.7-10.el9 @epel 13 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: ledmon-libs x86_64 1.1.0-3.el9 @baseos 80 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: libcephsqlite x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 425 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: libconfig x86_64 1.7.2-9.el9 @baseos 220 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: libgfortran x86_64 11.5.0-14.el9 @baseos 2.8 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: liboath x86_64 2.6.12-1.el9 @epel 94 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: libquadmath x86_64 11.5.0-14.el9 @baseos 330 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: libradosstriper1 x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 1.6 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: libstoragemgmt x86_64 1.10.1-1.el9 @appstream 685 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: libunwind x86_64 1.6.2-1.el9 @epel 170 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: openblas x86_64 0.3.29-1.el9 @appstream 112 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: openblas-openmp x86_64 0.3.29-1.el9 @appstream 46 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: pciutils x86_64 3.7.0-7.el9 @baseos 216 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: protobuf x86_64 3.14.0-17.el9 @appstream 3.5 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: protobuf-compiler x86_64 3.14.0-17.el9 @crb 2.9 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: python3-asyncssh noarch 2.13.2-5.el9 @epel 3.9 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: python3-autocommand noarch 2.2.2-8.el9 @epel 82 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: python3-babel noarch 2.9.1-2.el9 @appstream 27 M 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 @epel 254 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: python3-bcrypt x86_64 3.2.2-1.el9 @epel 87 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: python3-cachetools noarch 4.2.4-1.el9 @epel 93 k 2026-03-09T15:34:09.240 INFO:teuthology.orchestra.run.vm04.stdout: python3-ceph-common x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 702 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-certifi noarch 2023.05.07-4.el9 @epel 6.3 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-cffi x86_64 1.14.5-5.el9 @baseos 1.0 M 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-chardet noarch 4.0.0-5.el9 @anaconda 1.4 M 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-cheroot noarch 10.0.1-4.el9 @epel 682 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-cherrypy noarch 18.6.1-2.el9 @epel 1.1 M 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-cryptography x86_64 36.0.1-5.el9 @baseos 4.5 M 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-devel x86_64 3.9.25-3.el9 @appstream 765 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-google-auth noarch 1:2.45.0-1.el9 @epel 1.4 M 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-grpcio x86_64 1.46.7-10.el9 @epel 6.7 M 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 @epel 418 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-idna noarch 2.10-7.el9.1 @anaconda 513 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco noarch 8.2.1-3.el9 @epel 3.7 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 @epel 24 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 @epel 55 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-context noarch 6.0.1-3.el9 @epel 31 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 @epel 33 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-text noarch 4.0.0-2.el9 @epel 51 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-jinja2 noarch 2.11.3-8.el9 @appstream 1.1 M 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-jsonpatch noarch 1.21-16.el9 @koji-override-0 55 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-jsonpointer noarch 2.0-4.el9 @koji-override-0 34 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 @epel 21 M 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 @appstream 832 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-logutils noarch 0.3.5-21.el9 @epel 126 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-mako noarch 1.1.4-6.el9 @appstream 534 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-markupsafe x86_64 1.1.1-12.el9 @appstream 60 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-more-itertools noarch 8.12.0-2.el9 @epel 378 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-natsort noarch 7.1.1-5.el9 @epel 215 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-numpy x86_64 1:1.23.5-2.el9 @appstream 30 M 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 @appstream 1.7 M 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-oauthlib noarch 3.1.1-5.el9 @koji-override-0 888 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-packaging noarch 20.9-5.el9 @appstream 248 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-pecan noarch 1.4.2-3.el9 @epel 1.3 M 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-ply noarch 3.11-14.el9 @baseos 430 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-portend noarch 3.1.0-2.el9 @epel 20 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-prettytable noarch 0.7.2-27.el9 @koji-override-0 166 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-protobuf noarch 3.14.0-17.el9 @appstream 1.4 M 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 @epel 389 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-pyasn1 noarch 0.4.8-7.el9 @appstream 622 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 @appstream 1.0 M 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-pycparser noarch 2.20-6.el9 @baseos 745 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-pysocks noarch 1.7.1-12.el9 @anaconda 88 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-pytz noarch 2021.1-5.el9 @koji-override-0 176 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-repoze-lru noarch 0.7-16.el9 @epel 83 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-requests noarch 2.25.1-10.el9 @baseos 405 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 @appstream 119 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-routes noarch 2.5.1-5.el9 @epel 459 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-rsa noarch 4.9-2.el9 @epel 202 k 2026-03-09T15:34:09.241 INFO:teuthology.orchestra.run.vm04.stdout: python3-scipy x86_64 1.9.3-2.el9 @appstream 76 M 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout: python3-tempora noarch 5.0.0-2.el9 @epel 96 k 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout: python3-toml noarch 0.10.2-6.el9 @appstream 99 k 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout: python3-typing-extensions noarch 4.15.0-1.el9 @epel 447 k 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout: python3-urllib3 noarch 1.26.5-7.el9 @baseos 746 k 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout: python3-webob noarch 1.8.8-2.el9 @epel 1.2 M 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout: python3-websocket-client noarch 1.2.3-2.el9 @epel 319 k 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 @epel 1.9 M 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout: python3-zc-lockfile noarch 2.0-10.el9 @epel 35 k 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout: qatlib x86_64 25.08.0-2.el9 @appstream 639 k 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout: qatlib-service x86_64 25.08.0-2.el9 @appstream 69 k 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout: qatzip-libs x86_64 1.3.1-1.el9 @appstream 148 k 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout:Transaction Summary 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout:=========================================================================================== 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout:Remove 102 Packages 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout:Freed space: 613 M 2026-03-09T15:34:09.242 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction check 2026-03-09T15:34:09.265 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:09.269 INFO:teuthology.orchestra.run.vm04.stdout:Transaction check succeeded. 2026-03-09T15:34:09.269 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction test 2026-03-09T15:34:09.271 INFO:teuthology.orchestra.run.vm03.stdout:=========================================================================================== 2026-03-09T15:34:09.271 INFO:teuthology.orchestra.run.vm03.stdout: Package Arch Version Repository Size 2026-03-09T15:34:09.271 INFO:teuthology.orchestra.run.vm03.stdout:=========================================================================================== 2026-03-09T15:34:09.271 INFO:teuthology.orchestra.run.vm03.stdout:Removing: 2026-03-09T15:34:09.271 INFO:teuthology.orchestra.run.vm03.stdout: ceph-base x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 23 M 2026-03-09T15:34:09.271 INFO:teuthology.orchestra.run.vm03.stdout:Removing dependent packages: 2026-03-09T15:34:09.271 INFO:teuthology.orchestra.run.vm03.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 431 k 2026-03-09T15:34:09.271 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 3.4 M 2026-03-09T15:34:09.271 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-cephadm noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 806 k 2026-03-09T15:34:09.271 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-dashboard noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 88 M 2026-03-09T15:34:09.271 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 66 M 2026-03-09T15:34:09.271 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-rook noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 563 k 2026-03-09T15:34:09.271 INFO:teuthology.orchestra.run.vm03.stdout: ceph-osd x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 59 M 2026-03-09T15:34:09.271 INFO:teuthology.orchestra.run.vm03.stdout: ceph-volume noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 1.4 M 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: rbd-mirror x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 13 M 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout:Removing unused dependencies: 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: abseil-cpp x86_64 20211102.0-4.el9 @epel 1.9 M 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: ceph-common x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 85 M 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: ceph-grafana-dashboards noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 628 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-modules-core noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 1.5 M 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: ceph-prometheus-alerts noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 52 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: ceph-selinux x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 138 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: cryptsetup x86_64 2.8.1-3.el9 @baseos 770 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: flexiblas x86_64 3.0.4-9.el9 @appstream 68 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 @appstream 11 M 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 @appstream 39 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: gperftools-libs x86_64 2.9.1-3.el9 @epel 1.4 M 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: grpc-data noarch 1.46.7-10.el9 @epel 13 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: ledmon-libs x86_64 1.1.0-3.el9 @baseos 80 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: libcephsqlite x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 425 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: libconfig x86_64 1.7.2-9.el9 @baseos 220 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: libgfortran x86_64 11.5.0-14.el9 @baseos 2.8 M 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: liboath x86_64 2.6.12-1.el9 @epel 94 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: libquadmath x86_64 11.5.0-14.el9 @baseos 330 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: libradosstriper1 x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 1.6 M 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: libstoragemgmt x86_64 1.10.1-1.el9 @appstream 685 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: libunwind x86_64 1.6.2-1.el9 @epel 170 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: openblas x86_64 0.3.29-1.el9 @appstream 112 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: openblas-openmp x86_64 0.3.29-1.el9 @appstream 46 M 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: pciutils x86_64 3.7.0-7.el9 @baseos 216 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: protobuf x86_64 3.14.0-17.el9 @appstream 3.5 M 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: protobuf-compiler x86_64 3.14.0-17.el9 @crb 2.9 M 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: python3-asyncssh noarch 2.13.2-5.el9 @epel 3.9 M 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: python3-autocommand noarch 2.2.2-8.el9 @epel 82 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: python3-babel noarch 2.9.1-2.el9 @appstream 27 M 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 @epel 254 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: python3-bcrypt x86_64 3.2.2-1.el9 @epel 87 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: python3-cachetools noarch 4.2.4-1.el9 @epel 93 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: python3-ceph-common x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 702 k 2026-03-09T15:34:09.272 INFO:teuthology.orchestra.run.vm03.stdout: python3-certifi noarch 2023.05.07-4.el9 @epel 6.3 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-cffi x86_64 1.14.5-5.el9 @baseos 1.0 M 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-chardet noarch 4.0.0-5.el9 @anaconda 1.4 M 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-cheroot noarch 10.0.1-4.el9 @epel 682 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-cherrypy noarch 18.6.1-2.el9 @epel 1.1 M 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-cryptography x86_64 36.0.1-5.el9 @baseos 4.5 M 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-devel x86_64 3.9.25-3.el9 @appstream 765 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-google-auth noarch 1:2.45.0-1.el9 @epel 1.4 M 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-grpcio x86_64 1.46.7-10.el9 @epel 6.7 M 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 @epel 418 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-idna noarch 2.10-7.el9.1 @anaconda 513 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco noarch 8.2.1-3.el9 @epel 3.7 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 @epel 24 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 @epel 55 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-context noarch 6.0.1-3.el9 @epel 31 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 @epel 33 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-text noarch 4.0.0-2.el9 @epel 51 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-jinja2 noarch 2.11.3-8.el9 @appstream 1.1 M 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-jsonpatch noarch 1.21-16.el9 @koji-override-0 55 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-jsonpointer noarch 2.0-4.el9 @koji-override-0 34 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 @epel 21 M 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 @appstream 832 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-logutils noarch 0.3.5-21.el9 @epel 126 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-mako noarch 1.1.4-6.el9 @appstream 534 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-markupsafe x86_64 1.1.1-12.el9 @appstream 60 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-more-itertools noarch 8.12.0-2.el9 @epel 378 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-natsort noarch 7.1.1-5.el9 @epel 215 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-numpy x86_64 1:1.23.5-2.el9 @appstream 30 M 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 @appstream 1.7 M 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-oauthlib noarch 3.1.1-5.el9 @koji-override-0 888 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-packaging noarch 20.9-5.el9 @appstream 248 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-pecan noarch 1.4.2-3.el9 @epel 1.3 M 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-ply noarch 3.11-14.el9 @baseos 430 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-portend noarch 3.1.0-2.el9 @epel 20 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-prettytable noarch 0.7.2-27.el9 @koji-override-0 166 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-protobuf noarch 3.14.0-17.el9 @appstream 1.4 M 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 @epel 389 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyasn1 noarch 0.4.8-7.el9 @appstream 622 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 @appstream 1.0 M 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-pycparser noarch 2.20-6.el9 @baseos 745 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-pysocks noarch 1.7.1-12.el9 @anaconda 88 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-pytz noarch 2021.1-5.el9 @koji-override-0 176 k 2026-03-09T15:34:09.273 INFO:teuthology.orchestra.run.vm03.stdout: python3-repoze-lru noarch 0.7-16.el9 @epel 83 k 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: python3-requests noarch 2.25.1-10.el9 @baseos 405 k 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 @appstream 119 k 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: python3-routes noarch 2.5.1-5.el9 @epel 459 k 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: python3-rsa noarch 4.9-2.el9 @epel 202 k 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: python3-scipy x86_64 1.9.3-2.el9 @appstream 76 M 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: python3-tempora noarch 5.0.0-2.el9 @epel 96 k 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: python3-toml noarch 0.10.2-6.el9 @appstream 99 k 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: python3-typing-extensions noarch 4.15.0-1.el9 @epel 447 k 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: python3-urllib3 noarch 1.26.5-7.el9 @baseos 746 k 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: python3-webob noarch 1.8.8-2.el9 @epel 1.2 M 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: python3-websocket-client noarch 1.2.3-2.el9 @epel 319 k 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 @epel 1.9 M 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: python3-zc-lockfile noarch 2.0-10.el9 @epel 35 k 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: qatlib x86_64 25.08.0-2.el9 @appstream 639 k 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: qatlib-service x86_64 25.08.0-2.el9 @appstream 69 k 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: qatzip-libs x86_64 1.3.1-1.el9 @appstream 148 k 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout:Transaction Summary 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout:=========================================================================================== 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout:Remove 102 Packages 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout:Freed space: 613 M 2026-03-09T15:34:09.274 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction check 2026-03-09T15:34:09.302 INFO:teuthology.orchestra.run.vm03.stdout:Transaction check succeeded. 2026-03-09T15:34:09.302 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction test 2026-03-09T15:34:09.382 INFO:teuthology.orchestra.run.vm04.stdout:Transaction test succeeded. 2026-03-09T15:34:09.382 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction 2026-03-09T15:34:09.419 INFO:teuthology.orchestra.run.vm03.stdout:Transaction test succeeded. 2026-03-09T15:34:09.420 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction 2026-03-09T15:34:09.538 INFO:teuthology.orchestra.run.vm04.stdout: Preparing : 1/1 2026-03-09T15:34:09.538 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 1/102 2026-03-09T15:34:09.547 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 1/102 2026-03-09T15:34:09.566 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 2/102 2026-03-09T15:34:09.566 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:09.566 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-03-09T15:34:09.566 INFO:teuthology.orchestra.run.vm04.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mgr.target". 2026-03-09T15:34:09.566 INFO:teuthology.orchestra.run.vm04.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mgr.target". 2026-03-09T15:34:09.566 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:09.567 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 2/102 2026-03-09T15:34:09.578 INFO:teuthology.orchestra.run.vm03.stdout: Preparing : 1/1 2026-03-09T15:34:09.578 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 1/102 2026-03-09T15:34:09.582 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 2/102 2026-03-09T15:34:09.587 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 1/102 2026-03-09T15:34:09.606 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 2/102 2026-03-09T15:34:09.607 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:09.607 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-03-09T15:34:09.607 INFO:teuthology.orchestra.run.vm03.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mgr.target". 2026-03-09T15:34:09.607 INFO:teuthology.orchestra.run.vm03.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mgr.target". 2026-03-09T15:34:09.607 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:09.607 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9 3/102 2026-03-09T15:34:09.607 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 4/102 2026-03-09T15:34:09.607 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 2/102 2026-03-09T15:34:09.620 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 2/102 2026-03-09T15:34:09.647 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9 3/102 2026-03-09T15:34:09.647 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 4/102 2026-03-09T15:34:09.667 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 4/102 2026-03-09T15:34:09.676 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-kubernetes-1:26.1.0-3.el9.noarch 5/102 2026-03-09T15:34:09.682 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-requests-oauthlib-1.3.0-12.el9.noarch 6/102 2026-03-09T15:34:09.682 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 7/102 2026-03-09T15:34:09.696 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 7/102 2026-03-09T15:34:09.703 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-cherrypy-18.6.1-2.el9.noarch 8/102 2026-03-09T15:34:09.707 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-cheroot-10.0.1-4.el9.noarch 9/102 2026-03-09T15:34:09.708 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 4/102 2026-03-09T15:34:09.716 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-kubernetes-1:26.1.0-3.el9.noarch 5/102 2026-03-09T15:34:09.717 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/102 2026-03-09T15:34:09.720 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-requests-oauthlib-1.3.0-12.el9.noarch 6/102 2026-03-09T15:34:09.720 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 7/102 2026-03-09T15:34:09.721 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-grpcio-1.46.7-10.el9.x86_64 11/102 2026-03-09T15:34:09.733 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 7/102 2026-03-09T15:34:09.740 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-cherrypy-18.6.1-2.el9.noarch 8/102 2026-03-09T15:34:09.743 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-cheroot-10.0.1-4.el9.noarch 9/102 2026-03-09T15:34:09.744 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 12/102 2026-03-09T15:34:09.744 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:09.744 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-03-09T15:34:09.744 INFO:teuthology.orchestra.run.vm04.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-osd.target". 2026-03-09T15:34:09.744 INFO:teuthology.orchestra.run.vm04.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-osd.target". 2026-03-09T15:34:09.744 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:09.750 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 12/102 2026-03-09T15:34:09.751 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/102 2026-03-09T15:34:09.755 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-grpcio-1.46.7-10.el9.x86_64 11/102 2026-03-09T15:34:09.760 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 12/102 2026-03-09T15:34:09.777 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 12/102 2026-03-09T15:34:09.777 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:09.777 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-03-09T15:34:09.777 INFO:teuthology.orchestra.run.vm03.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-osd.target". 2026-03-09T15:34:09.777 INFO:teuthology.orchestra.run.vm03.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-osd.target". 2026-03-09T15:34:09.777 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:09.781 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 13/102 2026-03-09T15:34:09.781 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:09.781 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-03-09T15:34:09.781 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:09.782 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 12/102 2026-03-09T15:34:09.790 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 13/102 2026-03-09T15:34:09.791 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 12/102 2026-03-09T15:34:09.802 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 13/102 2026-03-09T15:34:09.805 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 13/102 2026-03-09T15:34:09.805 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:09.805 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-03-09T15:34:09.805 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:09.805 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/102 2026-03-09T15:34:09.810 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-jaraco-text-4.0.0-2.el9.noarch 15/102 2026-03-09T15:34:09.813 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 13/102 2026-03-09T15:34:09.815 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-jinja2-2.11.3-8.el9.noarch 16/102 2026-03-09T15:34:09.821 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 13/102 2026-03-09T15:34:09.823 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/102 2026-03-09T15:34:09.825 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-requests-2.25.1-10.el9.noarch 17/102 2026-03-09T15:34:09.828 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-jaraco-text-4.0.0-2.el9.noarch 15/102 2026-03-09T15:34:09.833 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-jinja2-2.11.3-8.el9.noarch 16/102 2026-03-09T15:34:09.838 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-google-auth-1:2.45.0-1.el9.noarch 18/102 2026-03-09T15:34:09.843 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-requests-2.25.1-10.el9.noarch 17/102 2026-03-09T15:34:09.846 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-pecan-1.4.2-3.el9.noarch 19/102 2026-03-09T15:34:09.859 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-rsa-4.9-2.el9.noarch 20/102 2026-03-09T15:34:09.860 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-google-auth-1:2.45.0-1.el9.noarch 18/102 2026-03-09T15:34:09.866 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-pyasn1-modules-0.4.8-7.el9.noarch 21/102 2026-03-09T15:34:09.868 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-pecan-1.4.2-3.el9.noarch 19/102 2026-03-09T15:34:09.878 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-rsa-4.9-2.el9.noarch 20/102 2026-03-09T15:34:09.885 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-pyasn1-modules-0.4.8-7.el9.noarch 21/102 2026-03-09T15:34:09.898 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-urllib3-1.26.5-7.el9.noarch 22/102 2026-03-09T15:34:09.907 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-babel-2.9.1-2.el9.noarch 23/102 2026-03-09T15:34:09.910 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/102 2026-03-09T15:34:09.915 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-urllib3-1.26.5-7.el9.noarch 22/102 2026-03-09T15:34:09.920 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/102 2026-03-09T15:34:09.922 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-babel-2.9.1-2.el9.noarch 23/102 2026-03-09T15:34:09.925 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/102 2026-03-09T15:34:09.931 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-asyncssh-2.13.2-5.el9.noarch 26/102 2026-03-09T15:34:09.931 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 27/102 2026-03-09T15:34:09.934 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/102 2026-03-09T15:34:09.941 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 27/102 2026-03-09T15:34:09.947 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-asyncssh-2.13.2-5.el9.noarch 26/102 2026-03-09T15:34:09.947 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 27/102 2026-03-09T15:34:09.955 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 27/102 2026-03-09T15:34:10.048 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-jsonpatch-1.21-16.el9.noarch 28/102 2026-03-09T15:34:10.062 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-jsonpatch-1.21-16.el9.noarch 28/102 2026-03-09T15:34:10.064 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-scipy-1.9.3-2.el9.x86_64 29/102 2026-03-09T15:34:10.077 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-scipy-1.9.3-2.el9.x86_64 29/102 2026-03-09T15:34:10.078 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 30/102 2026-03-09T15:34:10.078 INFO:teuthology.orchestra.run.vm04.stdout:Removed "/etc/systemd/system/multi-user.target.wants/libstoragemgmt.service". 2026-03-09T15:34:10.078 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:10.080 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : libstoragemgmt-1.10.1-1.el9.x86_64 30/102 2026-03-09T15:34:10.093 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 30/102 2026-03-09T15:34:10.093 INFO:teuthology.orchestra.run.vm03.stdout:Removed "/etc/systemd/system/multi-user.target.wants/libstoragemgmt.service". 2026-03-09T15:34:10.093 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:10.094 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : libstoragemgmt-1.10.1-1.el9.x86_64 30/102 2026-03-09T15:34:10.114 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 30/102 2026-03-09T15:34:10.121 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 30/102 2026-03-09T15:34:10.131 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 31/102 2026-03-09T15:34:10.143 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-cryptography-36.0.1-5.el9.x86_64 32/102 2026-03-09T15:34:10.146 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : protobuf-compiler-3.14.0-17.el9.x86_64 33/102 2026-03-09T15:34:10.148 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-bcrypt-3.2.2-1.el9.x86_64 34/102 2026-03-09T15:34:10.152 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 31/102 2026-03-09T15:34:10.158 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-cryptography-36.0.1-5.el9.x86_64 32/102 2026-03-09T15:34:10.161 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : protobuf-compiler-3.14.0-17.el9.x86_64 33/102 2026-03-09T15:34:10.164 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-bcrypt-3.2.2-1.el9.x86_64 34/102 2026-03-09T15:34:10.171 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 35/102 2026-03-09T15:34:10.171 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:10.171 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-03-09T15:34:10.171 INFO:teuthology.orchestra.run.vm04.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target". 2026-03-09T15:34:10.171 INFO:teuthology.orchestra.run.vm04.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target". 2026-03-09T15:34:10.171 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:10.173 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 35/102 2026-03-09T15:34:10.186 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 35/102 2026-03-09T15:34:10.186 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:10.186 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-03-09T15:34:10.186 INFO:teuthology.orchestra.run.vm03.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target". 2026-03-09T15:34:10.186 INFO:teuthology.orchestra.run.vm03.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target". 2026-03-09T15:34:10.186 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:10.188 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 35/102 2026-03-09T15:34:10.188 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 35/102 2026-03-09T15:34:10.192 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-mako-1.1.4-6.el9.noarch 36/102 2026-03-09T15:34:10.194 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-jaraco-context-6.0.1-3.el9.noarch 37/102 2026-03-09T15:34:10.197 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-portend-3.1.0-2.el9.noarch 38/102 2026-03-09T15:34:10.199 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 35/102 2026-03-09T15:34:10.200 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-tempora-5.0.0-2.el9.noarch 39/102 2026-03-09T15:34:10.203 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-mako-1.1.4-6.el9.noarch 36/102 2026-03-09T15:34:10.204 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-jaraco-functools-3.5.0-2.el9.noarch 40/102 2026-03-09T15:34:10.205 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-jaraco-context-6.0.1-3.el9.noarch 37/102 2026-03-09T15:34:10.208 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-portend-3.1.0-2.el9.noarch 38/102 2026-03-09T15:34:10.208 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-routes-2.5.1-5.el9.noarch 41/102 2026-03-09T15:34:10.211 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-tempora-5.0.0-2.el9.noarch 39/102 2026-03-09T15:34:10.213 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-cffi-1.14.5-5.el9.x86_64 42/102 2026-03-09T15:34:10.214 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-jaraco-functools-3.5.0-2.el9.noarch 40/102 2026-03-09T15:34:10.219 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-routes-2.5.1-5.el9.noarch 41/102 2026-03-09T15:34:10.223 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-cffi-1.14.5-5.el9.x86_64 42/102 2026-03-09T15:34:10.262 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-pycparser-2.20-6.el9.noarch 43/102 2026-03-09T15:34:10.273 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-numpy-1:1.23.5-2.el9.x86_64 44/102 2026-03-09T15:34:10.275 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : flexiblas-netlib-3.0.4-9.el9.x86_64 45/102 2026-03-09T15:34:10.280 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-pycparser-2.20-6.el9.noarch 43/102 2026-03-09T15:34:10.280 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 46/102 2026-03-09T15:34:10.282 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : openblas-openmp-0.3.29-1.el9.x86_64 47/102 2026-03-09T15:34:10.286 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : libgfortran-11.5.0-14.el9.x86_64 48/102 2026-03-09T15:34:10.290 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 49/102 2026-03-09T15:34:10.296 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-numpy-1:1.23.5-2.el9.x86_64 44/102 2026-03-09T15:34:10.300 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : flexiblas-netlib-3.0.4-9.el9.x86_64 45/102 2026-03-09T15:34:10.307 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 46/102 2026-03-09T15:34:10.310 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : openblas-openmp-0.3.29-1.el9.x86_64 47/102 2026-03-09T15:34:10.313 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-678.ge911bd 50/102 2026-03-09T15:34:10.313 INFO:teuthology.orchestra.run.vm04.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:10.313 INFO:teuthology.orchestra.run.vm04.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-03-09T15:34:10.313 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:10.314 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-immutable-object-cache-2:19.2.3-678.ge911bd 50/102 2026-03-09T15:34:10.315 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : libgfortran-11.5.0-14.el9.x86_64 48/102 2026-03-09T15:34:10.318 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 49/102 2026-03-09T15:34:10.325 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-678.ge911bd 50/102 2026-03-09T15:34:10.327 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : openblas-0.3.29-1.el9.x86_64 51/102 2026-03-09T15:34:10.330 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : flexiblas-3.0.4-9.el9.x86_64 52/102 2026-03-09T15:34:10.334 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-ply-3.11-14.el9.noarch 53/102 2026-03-09T15:34:10.336 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-repoze-lru-0.7-16.el9.noarch 54/102 2026-03-09T15:34:10.339 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-jaraco-8.2.1-3.el9.noarch 55/102 2026-03-09T15:34:10.342 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-more-itertools-8.12.0-2.el9.noarch 56/102 2026-03-09T15:34:10.345 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-toml-0.10.2-6.el9.noarch 57/102 2026-03-09T15:34:10.346 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-678.ge911bd 50/102 2026-03-09T15:34:10.346 INFO:teuthology.orchestra.run.vm03.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T15:34:10.346 INFO:teuthology.orchestra.run.vm03.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-03-09T15:34:10.346 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:10.346 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-immutable-object-cache-2:19.2.3-678.ge911bd 50/102 2026-03-09T15:34:10.348 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-pytz-2021.1-5.el9.noarch 58/102 2026-03-09T15:34:10.356 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-backports-tarfile-1.2.0-1.el9.noarch 59/102 2026-03-09T15:34:10.357 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-678.ge911bd 50/102 2026-03-09T15:34:10.358 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : openblas-0.3.29-1.el9.x86_64 51/102 2026-03-09T15:34:10.361 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-devel-3.9.25-3.el9.x86_64 60/102 2026-03-09T15:34:10.361 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : flexiblas-3.0.4-9.el9.x86_64 52/102 2026-03-09T15:34:10.363 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-jsonpointer-2.0-4.el9.noarch 61/102 2026-03-09T15:34:10.364 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-ply-3.11-14.el9.noarch 53/102 2026-03-09T15:34:10.365 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-typing-extensions-4.15.0-1.el9.noarch 62/102 2026-03-09T15:34:10.366 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-repoze-lru-0.7-16.el9.noarch 54/102 2026-03-09T15:34:10.368 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-jaraco-8.2.1-3.el9.noarch 55/102 2026-03-09T15:34:10.368 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-idna-2.10-7.el9.1.noarch 63/102 2026-03-09T15:34:10.371 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-more-itertools-8.12.0-2.el9.noarch 56/102 2026-03-09T15:34:10.373 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-pysocks-1.7.1-12.el9.noarch 64/102 2026-03-09T15:34:10.374 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-toml-0.10.2-6.el9.noarch 57/102 2026-03-09T15:34:10.377 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-pytz-2021.1-5.el9.noarch 58/102 2026-03-09T15:34:10.378 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-pyasn1-0.4.8-7.el9.noarch 65/102 2026-03-09T15:34:10.384 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-logutils-0.3.5-21.el9.noarch 66/102 2026-03-09T15:34:10.384 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-backports-tarfile-1.2.0-1.el9.noarch 59/102 2026-03-09T15:34:10.389 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-webob-1.8.8-2.el9.noarch 67/102 2026-03-09T15:34:10.389 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-devel-3.9.25-3.el9.x86_64 60/102 2026-03-09T15:34:10.392 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-jsonpointer-2.0-4.el9.noarch 61/102 2026-03-09T15:34:10.394 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-typing-extensions-4.15.0-1.el9.noarch 62/102 2026-03-09T15:34:10.395 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-cachetools-4.2.4-1.el9.noarch 68/102 2026-03-09T15:34:10.397 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-idna-2.10-7.el9.1.noarch 63/102 2026-03-09T15:34:10.399 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-chardet-4.0.0-5.el9.noarch 69/102 2026-03-09T15:34:10.402 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-pysocks-1.7.1-12.el9.noarch 64/102 2026-03-09T15:34:10.403 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-autocommand-2.2.2-8.el9.noarch 70/102 2026-03-09T15:34:10.406 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-packaging-20.9-5.el9.noarch 71/102 2026-03-09T15:34:10.406 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-pyasn1-0.4.8-7.el9.noarch 65/102 2026-03-09T15:34:10.412 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : grpc-data-1.46.7-10.el9.noarch 72/102 2026-03-09T15:34:10.412 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-logutils-0.3.5-21.el9.noarch 66/102 2026-03-09T15:34:10.416 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-webob-1.8.8-2.el9.noarch 67/102 2026-03-09T15:34:10.417 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-protobuf-3.14.0-17.el9.noarch 73/102 2026-03-09T15:34:10.421 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-zc-lockfile-2.0-10.el9.noarch 74/102 2026-03-09T15:34:10.422 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-cachetools-4.2.4-1.el9.noarch 68/102 2026-03-09T15:34:10.425 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-chardet-4.0.0-5.el9.noarch 69/102 2026-03-09T15:34:10.429 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-autocommand-2.2.2-8.el9.noarch 70/102 2026-03-09T15:34:10.431 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-natsort-7.1.1-5.el9.noarch 75/102 2026-03-09T15:34:10.431 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-packaging-20.9-5.el9.noarch 71/102 2026-03-09T15:34:10.436 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-oauthlib-3.1.1-5.el9.noarch 76/102 2026-03-09T15:34:10.437 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : grpc-data-1.46.7-10.el9.noarch 72/102 2026-03-09T15:34:10.440 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-protobuf-3.14.0-17.el9.noarch 73/102 2026-03-09T15:34:10.440 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-websocket-client-1.2.3-2.el9.noarch 77/102 2026-03-09T15:34:10.442 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-certifi-2023.05.07-4.el9.noarch 78/102 2026-03-09T15:34:10.443 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-zc-lockfile-2.0-10.el9.noarch 74/102 2026-03-09T15:34:10.446 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.e 79/102 2026-03-09T15:34:10.451 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el 80/102 2026-03-09T15:34:10.452 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-natsort-7.1.1-5.el9.noarch 75/102 2026-03-09T15:34:10.455 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-werkzeug-2.0.3-3.el9.1.noarch 81/102 2026-03-09T15:34:10.457 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-oauthlib-3.1.1-5.el9.noarch 76/102 2026-03-09T15:34:10.460 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-websocket-client-1.2.3-2.el9.noarch 77/102 2026-03-09T15:34:10.463 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-certifi-2023.05.07-4.el9.noarch 78/102 2026-03-09T15:34:10.464 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.e 79/102 2026-03-09T15:34:10.470 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el 80/102 2026-03-09T15:34:10.475 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-werkzeug-2.0.3-3.el9.1.noarch 81/102 2026-03-09T15:34:10.478 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 82/102 2026-03-09T15:34:10.478 INFO:teuthology.orchestra.run.vm04.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-crash.service". 2026-03-09T15:34:10.478 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:10.487 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 82/102 2026-03-09T15:34:10.497 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 82/102 2026-03-09T15:34:10.497 INFO:teuthology.orchestra.run.vm03.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-crash.service". 2026-03-09T15:34:10.497 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:10.504 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 82/102 2026-03-09T15:34:10.517 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 82/102 2026-03-09T15:34:10.518 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 83/102 2026-03-09T15:34:10.533 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 83/102 2026-03-09T15:34:10.540 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : qatzip-libs-1.3.1-1.el9.x86_64 84/102 2026-03-09T15:34:10.540 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 82/102 2026-03-09T15:34:10.540 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 83/102 2026-03-09T15:34:10.544 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x 85/102 2026-03-09T15:34:10.546 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-prettytable-0.7.2-27.el9.noarch 86/102 2026-03-09T15:34:10.546 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 87/102 2026-03-09T15:34:10.557 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 83/102 2026-03-09T15:34:10.562 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : qatzip-libs-1.3.1-1.el9.x86_64 84/102 2026-03-09T15:34:10.566 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x 85/102 2026-03-09T15:34:10.568 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-prettytable-0.7.2-27.el9.noarch 86/102 2026-03-09T15:34:10.568 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 87/102 2026-03-09T15:34:16.807 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 87/102 2026-03-09T15:34:16.807 INFO:teuthology.orchestra.run.vm03.stdout:skipping the directory /sys 2026-03-09T15:34:16.807 INFO:teuthology.orchestra.run.vm03.stdout:skipping the directory /proc 2026-03-09T15:34:16.807 INFO:teuthology.orchestra.run.vm03.stdout:skipping the directory /mnt 2026-03-09T15:34:16.807 INFO:teuthology.orchestra.run.vm03.stdout:skipping the directory /var/tmp 2026-03-09T15:34:16.807 INFO:teuthology.orchestra.run.vm03.stdout:skipping the directory /home 2026-03-09T15:34:16.807 INFO:teuthology.orchestra.run.vm03.stdout:skipping the directory /root 2026-03-09T15:34:16.807 INFO:teuthology.orchestra.run.vm03.stdout:skipping the directory /tmp 2026-03-09T15:34:16.807 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:16.817 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : qatlib-25.08.0-2.el9.x86_64 88/102 2026-03-09T15:34:16.837 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 89/102 2026-03-09T15:34:16.837 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : qatlib-service-25.08.0-2.el9.x86_64 89/102 2026-03-09T15:34:16.846 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 89/102 2026-03-09T15:34:16.849 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : gperftools-libs-2.9.1-3.el9.x86_64 90/102 2026-03-09T15:34:16.852 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : libunwind-1.6.2-1.el9.x86_64 91/102 2026-03-09T15:34:16.855 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : pciutils-3.7.0-7.el9.x86_64 92/102 2026-03-09T15:34:16.857 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : liboath-2.6.12-1.el9.x86_64 93/102 2026-03-09T15:34:16.857 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 94/102 2026-03-09T15:34:16.872 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 94/102 2026-03-09T15:34:16.875 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ledmon-libs-1.1.0-3.el9.x86_64 95/102 2026-03-09T15:34:16.877 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : libquadmath-11.5.0-14.el9.x86_64 96/102 2026-03-09T15:34:16.881 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-markupsafe-1.1.1-12.el9.x86_64 97/102 2026-03-09T15:34:16.884 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : protobuf-3.14.0-17.el9.x86_64 98/102 2026-03-09T15:34:16.890 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : libconfig-1.7.2-9.el9.x86_64 99/102 2026-03-09T15:34:16.898 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : cryptsetup-2.8.1-3.el9.x86_64 100/102 2026-03-09T15:34:16.903 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : abseil-cpp-20211102.0-4.el9.x86_64 101/102 2026-03-09T15:34:16.904 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 102/102 2026-03-09T15:34:16.933 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 87/102 2026-03-09T15:34:16.933 INFO:teuthology.orchestra.run.vm04.stdout:skipping the directory /sys 2026-03-09T15:34:16.933 INFO:teuthology.orchestra.run.vm04.stdout:skipping the directory /proc 2026-03-09T15:34:16.933 INFO:teuthology.orchestra.run.vm04.stdout:skipping the directory /mnt 2026-03-09T15:34:16.933 INFO:teuthology.orchestra.run.vm04.stdout:skipping the directory /var/tmp 2026-03-09T15:34:16.933 INFO:teuthology.orchestra.run.vm04.stdout:skipping the directory /home 2026-03-09T15:34:16.934 INFO:teuthology.orchestra.run.vm04.stdout:skipping the directory /root 2026-03-09T15:34:16.934 INFO:teuthology.orchestra.run.vm04.stdout:skipping the directory /tmp 2026-03-09T15:34:16.934 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:16.942 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : qatlib-25.08.0-2.el9.x86_64 88/102 2026-03-09T15:34:16.959 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 89/102 2026-03-09T15:34:16.959 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : qatlib-service-25.08.0-2.el9.x86_64 89/102 2026-03-09T15:34:16.967 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 89/102 2026-03-09T15:34:16.969 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : gperftools-libs-2.9.1-3.el9.x86_64 90/102 2026-03-09T15:34:16.972 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : libunwind-1.6.2-1.el9.x86_64 91/102 2026-03-09T15:34:16.974 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : pciutils-3.7.0-7.el9.x86_64 92/102 2026-03-09T15:34:16.976 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : liboath-2.6.12-1.el9.x86_64 93/102 2026-03-09T15:34:16.976 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 94/102 2026-03-09T15:34:16.988 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 94/102 2026-03-09T15:34:16.990 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ledmon-libs-1.1.0-3.el9.x86_64 95/102 2026-03-09T15:34:16.992 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : libquadmath-11.5.0-14.el9.x86_64 96/102 2026-03-09T15:34:16.995 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-markupsafe-1.1.1-12.el9.x86_64 97/102 2026-03-09T15:34:16.998 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : protobuf-3.14.0-17.el9.x86_64 98/102 2026-03-09T15:34:17.001 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 102/102 2026-03-09T15:34:17.001 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 1/102 2026-03-09T15:34:17.001 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 2/102 2026-03-09T15:34:17.001 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 3/102 2026-03-09T15:34:17.001 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.e 4/102 2026-03-09T15:34:17.001 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-678.ge911bd 5/102 2026-03-09T15:34:17.001 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 6/102 2026-03-09T15:34:17.001 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 7/102 2026-03-09T15:34:17.001 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 8/102 2026-03-09T15:34:17.001 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 9/102 2026-03-09T15:34:17.001 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9 10/102 2026-03-09T15:34:17.001 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 11/102 2026-03-09T15:34:17.001 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 12/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el 13/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 14/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 15/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 17/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 18/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 19/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 20/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 21/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 22/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 23/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 24/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 25/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 26/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 27/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 28/102 2026-03-09T15:34:17.002 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 29/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 31/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 32/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 33/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 34/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 35/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 36/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 37/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 39/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 40/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 41/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x 42/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 43/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 44/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-chardet-4.0.0-5.el9.noarch 45/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 46/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 47/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 48/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 49/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 50/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 51/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-idna-2.10-7.el9.1.noarch 53/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 54/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 55/102 2026-03-09T15:34:17.003 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 56/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 57/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 58/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 59/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 60/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 63/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 64/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 65/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 66/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 67/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 68/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 69/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 70/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 71/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 73/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 74/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-ply-3.11-14.el9.noarch 75/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 76/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 78/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 79/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 80/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 81/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-pysocks-1.7.1-12.el9.noarch 83/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 84/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 85/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 86/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/102 2026-03-09T15:34:17.004 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 90/102 2026-03-09T15:34:17.005 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/102 2026-03-09T15:34:17.005 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 92/102 2026-03-09T15:34:17.005 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/102 2026-03-09T15:34:17.005 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 94/102 2026-03-09T15:34:17.005 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 95/102 2026-03-09T15:34:17.005 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 96/102 2026-03-09T15:34:17.005 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 97/102 2026-03-09T15:34:17.005 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/102 2026-03-09T15:34:17.005 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 99/102 2026-03-09T15:34:17.005 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 100/102 2026-03-09T15:34:17.005 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 101/102 2026-03-09T15:34:17.005 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : libconfig-1.7.2-9.el9.x86_64 99/102 2026-03-09T15:34:17.012 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : cryptsetup-2.8.1-3.el9.x86_64 100/102 2026-03-09T15:34:17.016 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : abseil-cpp-20211102.0-4.el9.x86_64 101/102 2026-03-09T15:34:17.016 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 102/102 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 102/102 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout:Removed: 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ceph-immutable-object-cache-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-diskprediction-local-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: grpc-data-1.46.7-10.el9.noarch 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: libconfig-1.7.2-9.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: liboath-2.6.12-1.el9.x86_64 2026-03-09T15:34:17.085 INFO:teuthology.orchestra.run.vm03.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: libunwind-1.6.2-1.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: openblas-0.3.29-1.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: pciutils-3.7.0-7.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: protobuf-3.14.0-17.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-babel-2.9.1-2.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-chardet-4.0.0-5.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-idna-2.10-7.el9.1.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-jsonpatch-1.21-16.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-jsonpointer-2.0-4.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-mako-1.1.4-6.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-packaging-20.9-5.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-ply-3.11-14.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-portend-3.1.0-2.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-prettytable-0.7.2-27.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-pycparser-2.20-6.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-pysocks-1.7.1-12.el9.noarch 2026-03-09T15:34:17.086 INFO:teuthology.orchestra.run.vm03.stdout: python3-pytz-2021.1-5.el9.noarch 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: python3-requests-2.25.1-10.el9.noarch 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: python3-routes-2.5.1-5.el9.noarch 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: python3-rsa-4.9-2.el9.noarch 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: python3-toml-0.10.2-6.el9.noarch 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: python3-webob-1.8.8-2.el9.noarch 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: qatlib-25.08.0-2.el9.x86_64 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:17.087 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:17.113 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 102/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 1/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 2/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 3/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.e 4/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-678.ge911bd 5/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 6/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 7/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 8/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 9/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9 10/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 11/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 12/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el 13/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 14/102 2026-03-09T15:34:17.114 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 15/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 17/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 18/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 19/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 20/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 21/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 22/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 23/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 24/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 25/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 26/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 27/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 28/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 29/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 31/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 32/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 33/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 34/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 35/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 36/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 37/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 39/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 40/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 41/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x 42/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 43/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 44/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-chardet-4.0.0-5.el9.noarch 45/102 2026-03-09T15:34:17.116 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 46/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 47/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 48/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 49/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 50/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 51/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-idna-2.10-7.el9.1.noarch 53/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 54/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 55/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 56/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 57/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 58/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 59/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 60/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 63/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 64/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 65/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 66/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 67/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 68/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 69/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 70/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 71/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 73/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 74/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-ply-3.11-14.el9.noarch 75/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 76/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 78/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 79/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 80/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 81/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-pysocks-1.7.1-12.el9.noarch 83/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 84/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 85/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 86/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 90/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 92/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 94/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 95/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 96/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 97/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/102 2026-03-09T15:34:17.117 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 99/102 2026-03-09T15:34:17.118 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 100/102 2026-03-09T15:34:17.118 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 101/102 2026-03-09T15:34:17.197 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 102/102 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout:Removed: 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ceph-immutable-object-cache-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-diskprediction-local-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: grpc-data-1.46.7-10.el9.noarch 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: libconfig-1.7.2-9.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: liboath-2.6.12-1.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: libunwind-1.6.2-1.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: openblas-0.3.29-1.el9.x86_64 2026-03-09T15:34:17.198 INFO:teuthology.orchestra.run.vm04.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: pciutils-3.7.0-7.el9.x86_64 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: protobuf-3.14.0-17.el9.x86_64 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-babel-2.9.1-2.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-chardet-4.0.0-5.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-idna-2.10-7.el9.1.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-jsonpatch-1.21-16.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-jsonpointer-2.0-4.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-mako-1.1.4-6.el9.noarch 2026-03-09T15:34:17.199 INFO:teuthology.orchestra.run.vm04.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-packaging-20.9-5.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-ply-3.11-14.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-portend-3.1.0-2.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-prettytable-0.7.2-27.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-pycparser-2.20-6.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-pysocks-1.7.1-12.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-pytz-2021.1-5.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-requests-2.25.1-10.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-routes-2.5.1-5.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-rsa-4.9-2.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-toml-0.10.2-6.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-webob-1.8.8-2.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: qatlib-25.08.0-2.el9.x86_64 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:17.200 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:17.361 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:17.362 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:17.362 INFO:teuthology.orchestra.run.vm03.stdout: Package Arch Version Repository Size 2026-03-09T15:34:17.362 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:17.362 INFO:teuthology.orchestra.run.vm03.stdout:Removing: 2026-03-09T15:34:17.362 INFO:teuthology.orchestra.run.vm03.stdout: cephadm noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 775 k 2026-03-09T15:34:17.362 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:17.362 INFO:teuthology.orchestra.run.vm03.stdout:Transaction Summary 2026-03-09T15:34:17.362 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:17.362 INFO:teuthology.orchestra.run.vm03.stdout:Remove 1 Package 2026-03-09T15:34:17.362 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:17.362 INFO:teuthology.orchestra.run.vm03.stdout:Freed space: 775 k 2026-03-09T15:34:17.362 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction check 2026-03-09T15:34:17.365 INFO:teuthology.orchestra.run.vm03.stdout:Transaction check succeeded. 2026-03-09T15:34:17.365 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction test 2026-03-09T15:34:17.367 INFO:teuthology.orchestra.run.vm03.stdout:Transaction test succeeded. 2026-03-09T15:34:17.367 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction 2026-03-09T15:34:17.386 INFO:teuthology.orchestra.run.vm03.stdout: Preparing : 1/1 2026-03-09T15:34:17.386 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 1/1 2026-03-09T15:34:17.419 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:17.419 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:17.419 INFO:teuthology.orchestra.run.vm04.stdout: Package Arch Version Repository Size 2026-03-09T15:34:17.419 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:17.419 INFO:teuthology.orchestra.run.vm04.stdout:Removing: 2026-03-09T15:34:17.419 INFO:teuthology.orchestra.run.vm04.stdout: cephadm noarch 2:19.2.3-678.ge911bdeb.el9 @ceph-noarch 775 k 2026-03-09T15:34:17.419 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:17.419 INFO:teuthology.orchestra.run.vm04.stdout:Transaction Summary 2026-03-09T15:34:17.419 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:17.419 INFO:teuthology.orchestra.run.vm04.stdout:Remove 1 Package 2026-03-09T15:34:17.419 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:17.419 INFO:teuthology.orchestra.run.vm04.stdout:Freed space: 775 k 2026-03-09T15:34:17.419 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction check 2026-03-09T15:34:17.421 INFO:teuthology.orchestra.run.vm04.stdout:Transaction check succeeded. 2026-03-09T15:34:17.421 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction test 2026-03-09T15:34:17.422 INFO:teuthology.orchestra.run.vm04.stdout:Transaction test succeeded. 2026-03-09T15:34:17.423 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction 2026-03-09T15:34:17.439 INFO:teuthology.orchestra.run.vm04.stdout: Preparing : 1/1 2026-03-09T15:34:17.439 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 1/1 2026-03-09T15:34:17.526 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 1/1 2026-03-09T15:34:17.565 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 1/1 2026-03-09T15:34:17.579 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 1/1 2026-03-09T15:34:17.579 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:17.579 INFO:teuthology.orchestra.run.vm03.stdout:Removed: 2026-03-09T15:34:17.579 INFO:teuthology.orchestra.run.vm03.stdout: cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.579 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:17.579 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:17.632 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 1/1 2026-03-09T15:34:17.632 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:17.632 INFO:teuthology.orchestra.run.vm04.stdout:Removed: 2026-03-09T15:34:17.633 INFO:teuthology.orchestra.run.vm04.stdout: cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T15:34:17.633 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:17.633 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:17.783 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: ceph-immutable-object-cache 2026-03-09T15:34:17.783 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:17.786 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:17.786 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:17.786 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:17.843 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: ceph-immutable-object-cache 2026-03-09T15:34:17.844 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:17.847 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:17.848 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:17.848 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:17.981 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: ceph-mgr 2026-03-09T15:34:17.982 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:17.985 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:17.985 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:17.985 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:18.018 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: ceph-mgr 2026-03-09T15:34:18.018 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:18.021 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:18.022 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:18.022 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:18.170 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: ceph-mgr-dashboard 2026-03-09T15:34:18.170 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:18.173 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:18.174 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:18.174 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:18.216 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: ceph-mgr-dashboard 2026-03-09T15:34:18.216 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:18.219 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:18.220 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:18.220 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:18.351 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: ceph-mgr-diskprediction-local 2026-03-09T15:34:18.351 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:18.354 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:18.355 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:18.355 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:18.391 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: ceph-mgr-diskprediction-local 2026-03-09T15:34:18.391 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:18.394 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:18.394 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:18.394 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:18.539 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: ceph-mgr-rook 2026-03-09T15:34:18.539 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:18.543 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:18.543 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:18.543 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:18.589 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: ceph-mgr-rook 2026-03-09T15:34:18.589 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:18.593 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:18.594 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:18.594 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:18.738 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: ceph-mgr-cephadm 2026-03-09T15:34:18.738 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:18.741 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:18.742 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:18.742 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:18.782 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: ceph-mgr-cephadm 2026-03-09T15:34:18.782 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:18.785 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:18.786 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:18.786 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:18.929 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:18.930 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:18.930 INFO:teuthology.orchestra.run.vm03.stdout: Package Arch Version Repository Size 2026-03-09T15:34:18.930 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:18.930 INFO:teuthology.orchestra.run.vm03.stdout:Removing: 2026-03-09T15:34:18.930 INFO:teuthology.orchestra.run.vm03.stdout: ceph-fuse x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 3.6 M 2026-03-09T15:34:18.930 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:18.930 INFO:teuthology.orchestra.run.vm03.stdout:Transaction Summary 2026-03-09T15:34:18.930 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:18.930 INFO:teuthology.orchestra.run.vm03.stdout:Remove 1 Package 2026-03-09T15:34:18.930 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:18.930 INFO:teuthology.orchestra.run.vm03.stdout:Freed space: 3.6 M 2026-03-09T15:34:18.930 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction check 2026-03-09T15:34:18.932 INFO:teuthology.orchestra.run.vm03.stdout:Transaction check succeeded. 2026-03-09T15:34:18.932 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction test 2026-03-09T15:34:18.942 INFO:teuthology.orchestra.run.vm03.stdout:Transaction test succeeded. 2026-03-09T15:34:18.942 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction 2026-03-09T15:34:18.974 INFO:teuthology.orchestra.run.vm03.stdout: Preparing : 1/1 2026-03-09T15:34:18.978 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:18.978 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:18.978 INFO:teuthology.orchestra.run.vm04.stdout: Package Arch Version Repository Size 2026-03-09T15:34:18.978 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:18.978 INFO:teuthology.orchestra.run.vm04.stdout:Removing: 2026-03-09T15:34:18.978 INFO:teuthology.orchestra.run.vm04.stdout: ceph-fuse x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 3.6 M 2026-03-09T15:34:18.978 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:18.978 INFO:teuthology.orchestra.run.vm04.stdout:Transaction Summary 2026-03-09T15:34:18.978 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:18.978 INFO:teuthology.orchestra.run.vm04.stdout:Remove 1 Package 2026-03-09T15:34:18.978 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:18.979 INFO:teuthology.orchestra.run.vm04.stdout:Freed space: 3.6 M 2026-03-09T15:34:18.979 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction check 2026-03-09T15:34:18.980 INFO:teuthology.orchestra.run.vm04.stdout:Transaction check succeeded. 2026-03-09T15:34:18.980 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction test 2026-03-09T15:34:18.989 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 1/1 2026-03-09T15:34:18.991 INFO:teuthology.orchestra.run.vm04.stdout:Transaction test succeeded. 2026-03-09T15:34:18.992 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction 2026-03-09T15:34:19.018 INFO:teuthology.orchestra.run.vm04.stdout: Preparing : 1/1 2026-03-09T15:34:19.036 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 1/1 2026-03-09T15:34:19.054 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 1/1 2026-03-09T15:34:19.094 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 1/1 2026-03-09T15:34:19.095 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 1/1 2026-03-09T15:34:19.095 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:19.095 INFO:teuthology.orchestra.run.vm03.stdout:Removed: 2026-03-09T15:34:19.095 INFO:teuthology.orchestra.run.vm03.stdout: ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:19.095 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:19.095 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:19.143 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 1/1 2026-03-09T15:34:19.143 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:19.143 INFO:teuthology.orchestra.run.vm04.stdout:Removed: 2026-03-09T15:34:19.143 INFO:teuthology.orchestra.run.vm04.stdout: ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:19.143 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:19.143 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:19.299 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: ceph-volume 2026-03-09T15:34:19.300 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:19.303 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:19.304 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:19.304 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:19.334 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: ceph-volume 2026-03-09T15:34:19.334 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:19.339 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:19.340 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:19.340 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:19.510 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:19.511 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:19.511 INFO:teuthology.orchestra.run.vm03.stdout: Package Arch Version Repo Size 2026-03-09T15:34:19.511 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:19.511 INFO:teuthology.orchestra.run.vm03.stdout:Removing: 2026-03-09T15:34:19.511 INFO:teuthology.orchestra.run.vm03.stdout: librados-devel x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 456 k 2026-03-09T15:34:19.511 INFO:teuthology.orchestra.run.vm03.stdout:Removing dependent packages: 2026-03-09T15:34:19.511 INFO:teuthology.orchestra.run.vm03.stdout: libcephfs-devel x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 153 k 2026-03-09T15:34:19.511 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:19.511 INFO:teuthology.orchestra.run.vm03.stdout:Transaction Summary 2026-03-09T15:34:19.511 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:19.511 INFO:teuthology.orchestra.run.vm03.stdout:Remove 2 Packages 2026-03-09T15:34:19.511 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:19.511 INFO:teuthology.orchestra.run.vm03.stdout:Freed space: 610 k 2026-03-09T15:34:19.511 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction check 2026-03-09T15:34:19.513 INFO:teuthology.orchestra.run.vm03.stdout:Transaction check succeeded. 2026-03-09T15:34:19.513 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction test 2026-03-09T15:34:19.526 INFO:teuthology.orchestra.run.vm03.stdout:Transaction test succeeded. 2026-03-09T15:34:19.526 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction 2026-03-09T15:34:19.534 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:19.535 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:19.535 INFO:teuthology.orchestra.run.vm04.stdout: Package Arch Version Repo Size 2026-03-09T15:34:19.535 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:19.535 INFO:teuthology.orchestra.run.vm04.stdout:Removing: 2026-03-09T15:34:19.535 INFO:teuthology.orchestra.run.vm04.stdout: librados-devel x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 456 k 2026-03-09T15:34:19.535 INFO:teuthology.orchestra.run.vm04.stdout:Removing dependent packages: 2026-03-09T15:34:19.535 INFO:teuthology.orchestra.run.vm04.stdout: libcephfs-devel x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 153 k 2026-03-09T15:34:19.535 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:19.535 INFO:teuthology.orchestra.run.vm04.stdout:Transaction Summary 2026-03-09T15:34:19.535 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:19.535 INFO:teuthology.orchestra.run.vm04.stdout:Remove 2 Packages 2026-03-09T15:34:19.535 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:19.535 INFO:teuthology.orchestra.run.vm04.stdout:Freed space: 610 k 2026-03-09T15:34:19.535 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction check 2026-03-09T15:34:19.537 INFO:teuthology.orchestra.run.vm04.stdout:Transaction check succeeded. 2026-03-09T15:34:19.537 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction test 2026-03-09T15:34:19.547 INFO:teuthology.orchestra.run.vm04.stdout:Transaction test succeeded. 2026-03-09T15:34:19.548 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction 2026-03-09T15:34:19.552 INFO:teuthology.orchestra.run.vm03.stdout: Preparing : 1/1 2026-03-09T15:34:19.555 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 1/2 2026-03-09T15:34:19.568 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2/2 2026-03-09T15:34:19.574 INFO:teuthology.orchestra.run.vm04.stdout: Preparing : 1/1 2026-03-09T15:34:19.577 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 1/2 2026-03-09T15:34:19.591 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2/2 2026-03-09T15:34:19.642 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2/2 2026-03-09T15:34:19.642 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 1/2 2026-03-09T15:34:19.662 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2/2 2026-03-09T15:34:19.662 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 1/2 2026-03-09T15:34:19.698 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2/2 2026-03-09T15:34:19.698 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:19.698 INFO:teuthology.orchestra.run.vm03.stdout:Removed: 2026-03-09T15:34:19.698 INFO:teuthology.orchestra.run.vm03.stdout: libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:19.698 INFO:teuthology.orchestra.run.vm03.stdout: librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:19.698 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:19.698 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:19.707 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2/2 2026-03-09T15:34:19.707 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:19.707 INFO:teuthology.orchestra.run.vm04.stdout:Removed: 2026-03-09T15:34:19.707 INFO:teuthology.orchestra.run.vm04.stdout: libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:19.707 INFO:teuthology.orchestra.run.vm04.stdout: librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:19.707 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:19.707 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:19.925 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:19.925 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:19.925 INFO:teuthology.orchestra.run.vm03.stdout: Package Arch Version Repo Size 2026-03-09T15:34:19.925 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:19.925 INFO:teuthology.orchestra.run.vm03.stdout:Removing: 2026-03-09T15:34:19.925 INFO:teuthology.orchestra.run.vm03.stdout: libcephfs2 x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 3.0 M 2026-03-09T15:34:19.925 INFO:teuthology.orchestra.run.vm03.stdout:Removing dependent packages: 2026-03-09T15:34:19.925 INFO:teuthology.orchestra.run.vm03.stdout: python3-cephfs x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 514 k 2026-03-09T15:34:19.925 INFO:teuthology.orchestra.run.vm03.stdout:Removing unused dependencies: 2026-03-09T15:34:19.925 INFO:teuthology.orchestra.run.vm03.stdout: python3-ceph-argparse x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 187 k 2026-03-09T15:34:19.926 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:19.926 INFO:teuthology.orchestra.run.vm03.stdout:Transaction Summary 2026-03-09T15:34:19.926 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:19.926 INFO:teuthology.orchestra.run.vm03.stdout:Remove 3 Packages 2026-03-09T15:34:19.926 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:19.926 INFO:teuthology.orchestra.run.vm03.stdout:Freed space: 3.7 M 2026-03-09T15:34:19.926 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction check 2026-03-09T15:34:19.927 INFO:teuthology.orchestra.run.vm03.stdout:Transaction check succeeded. 2026-03-09T15:34:19.927 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction test 2026-03-09T15:34:19.931 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:19.931 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:19.931 INFO:teuthology.orchestra.run.vm04.stdout: Package Arch Version Repo Size 2026-03-09T15:34:19.931 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:19.931 INFO:teuthology.orchestra.run.vm04.stdout:Removing: 2026-03-09T15:34:19.931 INFO:teuthology.orchestra.run.vm04.stdout: libcephfs2 x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 3.0 M 2026-03-09T15:34:19.931 INFO:teuthology.orchestra.run.vm04.stdout:Removing dependent packages: 2026-03-09T15:34:19.931 INFO:teuthology.orchestra.run.vm04.stdout: python3-cephfs x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 514 k 2026-03-09T15:34:19.931 INFO:teuthology.orchestra.run.vm04.stdout:Removing unused dependencies: 2026-03-09T15:34:19.931 INFO:teuthology.orchestra.run.vm04.stdout: python3-ceph-argparse x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 187 k 2026-03-09T15:34:19.931 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:19.931 INFO:teuthology.orchestra.run.vm04.stdout:Transaction Summary 2026-03-09T15:34:19.931 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:19.931 INFO:teuthology.orchestra.run.vm04.stdout:Remove 3 Packages 2026-03-09T15:34:19.932 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:19.932 INFO:teuthology.orchestra.run.vm04.stdout:Freed space: 3.7 M 2026-03-09T15:34:19.932 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction check 2026-03-09T15:34:19.934 INFO:teuthology.orchestra.run.vm04.stdout:Transaction check succeeded. 2026-03-09T15:34:19.934 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction test 2026-03-09T15:34:19.945 INFO:teuthology.orchestra.run.vm03.stdout:Transaction test succeeded. 2026-03-09T15:34:19.945 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction 2026-03-09T15:34:19.951 INFO:teuthology.orchestra.run.vm04.stdout:Transaction test succeeded. 2026-03-09T15:34:19.951 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction 2026-03-09T15:34:19.978 INFO:teuthology.orchestra.run.vm03.stdout: Preparing : 1/1 2026-03-09T15:34:19.980 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 1/3 2026-03-09T15:34:19.983 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9.x86 2/3 2026-03-09T15:34:19.983 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 3/3 2026-03-09T15:34:19.986 INFO:teuthology.orchestra.run.vm04.stdout: Preparing : 1/1 2026-03-09T15:34:20.001 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 1/3 2026-03-09T15:34:20.003 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9.x86 2/3 2026-03-09T15:34:20.004 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 3/3 2026-03-09T15:34:20.062 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 3/3 2026-03-09T15:34:20.062 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 1/3 2026-03-09T15:34:20.062 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9.x86 2/3 2026-03-09T15:34:20.078 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 3/3 2026-03-09T15:34:20.078 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 1/3 2026-03-09T15:34:20.079 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9.x86 2/3 2026-03-09T15:34:20.104 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 3/3 2026-03-09T15:34:20.105 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:20.105 INFO:teuthology.orchestra.run.vm03.stdout:Removed: 2026-03-09T15:34:20.105 INFO:teuthology.orchestra.run.vm03.stdout: libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.105 INFO:teuthology.orchestra.run.vm03.stdout: python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.105 INFO:teuthology.orchestra.run.vm03.stdout: python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.105 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:20.105 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:20.125 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 3/3 2026-03-09T15:34:20.125 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:20.125 INFO:teuthology.orchestra.run.vm04.stdout:Removed: 2026-03-09T15:34:20.125 INFO:teuthology.orchestra.run.vm04.stdout: libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.125 INFO:teuthology.orchestra.run.vm04.stdout: python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.125 INFO:teuthology.orchestra.run.vm04.stdout: python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.125 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:20.125 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:20.286 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: libcephfs-devel 2026-03-09T15:34:20.286 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:20.289 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:20.290 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:20.290 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:20.324 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: libcephfs-devel 2026-03-09T15:34:20.324 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:20.328 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:20.328 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:20.328 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:20.468 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:20.469 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: Package Arch Version Repository Size 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout:Removing: 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: librados2 x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 12 M 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout:Removing dependent packages: 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: python3-rados x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 1.1 M 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: python3-rbd x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 1.1 M 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: python3-rgw x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 265 k 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: qemu-kvm-block-rbd x86_64 17:10.1.0-15.el9 @appstream 37 k 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: rbd-fuse x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 227 k 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: rbd-nbd x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 490 k 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout:Removing unused dependencies: 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: boost-program-options x86_64 1.75.0-13.el9 @appstream 276 k 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: libarrow x86_64 9.0.0-15.el9 @epel 18 M 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: libarrow-doc noarch 9.0.0-15.el9 @epel 122 k 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: libnbd x86_64 1.20.3-4.el9 @appstream 453 k 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: libpmemobj x86_64 1.12.1-1.el9 @appstream 383 k 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: librabbitmq x86_64 0.11.0-7.el9 @appstream 102 k 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: librbd1 x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 13 M 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: librdkafka x86_64 1.6.1-102.el9 @appstream 2.0 M 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: librgw2 x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 19 M 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: lttng-ust x86_64 2.12.0-6.el9 @appstream 1.0 M 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: parquet-libs x86_64 9.0.0-15.el9 @epel 2.8 M 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: re2 x86_64 1:20211101-20.el9 @epel 472 k 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: thrift x86_64 0.15.0-4.el9 @epel 4.8 M 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout:Transaction Summary 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout:Remove 20 Packages 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout:Freed space: 79 M 2026-03-09T15:34:20.470 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction check 2026-03-09T15:34:20.474 INFO:teuthology.orchestra.run.vm03.stdout:Transaction check succeeded. 2026-03-09T15:34:20.474 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction test 2026-03-09T15:34:20.496 INFO:teuthology.orchestra.run.vm03.stdout:Transaction test succeeded. 2026-03-09T15:34:20.496 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction 2026-03-09T15:34:20.534 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:20.535 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:20.535 INFO:teuthology.orchestra.run.vm04.stdout: Package Arch Version Repository Size 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout:Removing: 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: librados2 x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 12 M 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout:Removing dependent packages: 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: python3-rados x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 1.1 M 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: python3-rbd x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 1.1 M 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: python3-rgw x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 265 k 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: qemu-kvm-block-rbd x86_64 17:10.1.0-15.el9 @appstream 37 k 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: rbd-fuse x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 227 k 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: rbd-nbd x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 490 k 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout:Removing unused dependencies: 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: boost-program-options x86_64 1.75.0-13.el9 @appstream 276 k 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: libarrow x86_64 9.0.0-15.el9 @epel 18 M 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: libarrow-doc noarch 9.0.0-15.el9 @epel 122 k 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: libnbd x86_64 1.20.3-4.el9 @appstream 453 k 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: libpmemobj x86_64 1.12.1-1.el9 @appstream 383 k 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: librabbitmq x86_64 0.11.0-7.el9 @appstream 102 k 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: librbd1 x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 13 M 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: librdkafka x86_64 1.6.1-102.el9 @appstream 2.0 M 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: librgw2 x86_64 2:19.2.3-678.ge911bdeb.el9 @ceph 19 M 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: lttng-ust x86_64 2.12.0-6.el9 @appstream 1.0 M 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: parquet-libs x86_64 9.0.0-15.el9 @epel 2.8 M 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: re2 x86_64 1:20211101-20.el9 @epel 472 k 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: thrift x86_64 0.15.0-4.el9 @epel 4.8 M 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout:Transaction Summary 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout:================================================================================ 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout:Remove 20 Packages 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout:Freed space: 79 M 2026-03-09T15:34:20.536 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction check 2026-03-09T15:34:20.540 INFO:teuthology.orchestra.run.vm03.stdout: Preparing : 1/1 2026-03-09T15:34:20.541 INFO:teuthology.orchestra.run.vm04.stdout:Transaction check succeeded. 2026-03-09T15:34:20.541 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction test 2026-03-09T15:34:20.542 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 1/20 2026-03-09T15:34:20.544 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2/20 2026-03-09T15:34:20.548 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 3/20 2026-03-09T15:34:20.548 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 4/20 2026-03-09T15:34:20.565 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 4/20 2026-03-09T15:34:20.570 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : parquet-libs-9.0.0-15.el9.x86_64 5/20 2026-03-09T15:34:20.570 INFO:teuthology.orchestra.run.vm04.stdout:Transaction test succeeded. 2026-03-09T15:34:20.570 INFO:teuthology.orchestra.run.vm04.stdout:Running transaction 2026-03-09T15:34:20.573 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 6/20 2026-03-09T15:34:20.577 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 7/20 2026-03-09T15:34:20.578 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : qemu-kvm-block-rbd-17:10.1.0-15.el9.x86_64 8/20 2026-03-09T15:34:20.583 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : libarrow-doc-9.0.0-15.el9.noarch 9/20 2026-03-09T15:34:20.583 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 10/20 2026-03-09T15:34:20.599 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 10/20 2026-03-09T15:34:20.599 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 11/20 2026-03-09T15:34:20.599 INFO:teuthology.orchestra.run.vm03.stdout:warning: file /etc/ceph: remove failed: No such file or directory 2026-03-09T15:34:20.599 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:20.615 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 11/20 2026-03-09T15:34:20.617 INFO:teuthology.orchestra.run.vm04.stdout: Preparing : 1/1 2026-03-09T15:34:20.617 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : libarrow-9.0.0-15.el9.x86_64 12/20 2026-03-09T15:34:20.621 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 1/20 2026-03-09T15:34:20.621 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : re2-1:20211101-20.el9.x86_64 13/20 2026-03-09T15:34:20.623 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2/20 2026-03-09T15:34:20.624 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : lttng-ust-2.12.0-6.el9.x86_64 14/20 2026-03-09T15:34:20.627 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 3/20 2026-03-09T15:34:20.627 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 4/20 2026-03-09T15:34:20.627 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : thrift-0.15.0-4.el9.x86_64 15/20 2026-03-09T15:34:20.630 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : libnbd-1.20.3-4.el9.x86_64 16/20 2026-03-09T15:34:20.632 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : libpmemobj-1.12.1-1.el9.x86_64 17/20 2026-03-09T15:34:20.634 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : boost-program-options-1.75.0-13.el9.x86_64 18/20 2026-03-09T15:34:20.636 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : librabbitmq-0.11.0-7.el9.x86_64 19/20 2026-03-09T15:34:20.641 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 4/20 2026-03-09T15:34:20.643 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : parquet-libs-9.0.0-15.el9.x86_64 5/20 2026-03-09T15:34:20.645 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 6/20 2026-03-09T15:34:20.647 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 7/20 2026-03-09T15:34:20.648 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : qemu-kvm-block-rbd-17:10.1.0-15.el9.x86_64 8/20 2026-03-09T15:34:20.651 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : libarrow-doc-9.0.0-15.el9.noarch 9/20 2026-03-09T15:34:20.651 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 10/20 2026-03-09T15:34:20.651 INFO:teuthology.orchestra.run.vm03.stdout: Erasing : librdkafka-1.6.1-102.el9.x86_64 20/20 2026-03-09T15:34:20.665 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 10/20 2026-03-09T15:34:20.665 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 11/20 2026-03-09T15:34:20.665 INFO:teuthology.orchestra.run.vm04.stdout:warning: file /etc/ceph: remove failed: No such file or directory 2026-03-09T15:34:20.665 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:20.678 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 11/20 2026-03-09T15:34:20.680 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : libarrow-9.0.0-15.el9.x86_64 12/20 2026-03-09T15:34:20.683 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : re2-1:20211101-20.el9.x86_64 13/20 2026-03-09T15:34:20.687 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : lttng-ust-2.12.0-6.el9.x86_64 14/20 2026-03-09T15:34:20.690 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : thrift-0.15.0-4.el9.x86_64 15/20 2026-03-09T15:34:20.693 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : libnbd-1.20.3-4.el9.x86_64 16/20 2026-03-09T15:34:20.695 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : libpmemobj-1.12.1-1.el9.x86_64 17/20 2026-03-09T15:34:20.697 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : boost-program-options-1.75.0-13.el9.x86_64 18/20 2026-03-09T15:34:20.700 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : librabbitmq-0.11.0-7.el9.x86_64 19/20 2026-03-09T15:34:20.714 INFO:teuthology.orchestra.run.vm04.stdout: Erasing : librdkafka-1.6.1-102.el9.x86_64 20/20 2026-03-09T15:34:20.735 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: librdkafka-1.6.1-102.el9.x86_64 20/20 2026-03-09T15:34:20.735 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 1/20 2026-03-09T15:34:20.735 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 2/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 3/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 4/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 5/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 6/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 7/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 8/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 9/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 10/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 11/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 12/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 13/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 14/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 15/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : qemu-kvm-block-rbd-17:10.1.0-15.el9.x86_64 16/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 17/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 18/20 2026-03-09T15:34:20.736 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : re2-1:20211101-20.el9.x86_64 19/20 2026-03-09T15:34:20.778 INFO:teuthology.orchestra.run.vm04.stdout: Running scriptlet: librdkafka-1.6.1-102.el9.x86_64 20/20 2026-03-09T15:34:20.778 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 1/20 2026-03-09T15:34:20.778 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 2/20 2026-03-09T15:34:20.778 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 3/20 2026-03-09T15:34:20.778 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 4/20 2026-03-09T15:34:20.778 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 5/20 2026-03-09T15:34:20.778 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 6/20 2026-03-09T15:34:20.778 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 7/20 2026-03-09T15:34:20.778 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 8/20 2026-03-09T15:34:20.778 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 9/20 2026-03-09T15:34:20.779 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 10/20 2026-03-09T15:34:20.779 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 11/20 2026-03-09T15:34:20.779 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 12/20 2026-03-09T15:34:20.779 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 13/20 2026-03-09T15:34:20.779 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 14/20 2026-03-09T15:34:20.779 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 15/20 2026-03-09T15:34:20.779 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : qemu-kvm-block-rbd-17:10.1.0-15.el9.x86_64 16/20 2026-03-09T15:34:20.779 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 17/20 2026-03-09T15:34:20.779 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 18/20 2026-03-09T15:34:20.779 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : re2-1:20211101-20.el9.x86_64 19/20 2026-03-09T15:34:20.797 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 20/20 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout:Removed: 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: libarrow-9.0.0-15.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: libnbd-1.20.3-4.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: qemu-kvm-block-rbd-17:10.1.0-15.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: re2-1:20211101-20.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: thrift-0.15.0-4.el9.x86_64 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T15:34:20.798 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:20.837 INFO:teuthology.orchestra.run.vm04.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 20/20 2026-03-09T15:34:20.837 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:20.837 INFO:teuthology.orchestra.run.vm04.stdout:Removed: 2026-03-09T15:34:20.837 INFO:teuthology.orchestra.run.vm04.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-03-09T15:34:20.837 INFO:teuthology.orchestra.run.vm04.stdout: libarrow-9.0.0-15.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: libnbd-1.20.3-4.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: qemu-kvm-block-rbd-17:10.1.0-15.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: re2-1:20211101-20.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: thrift-0.15.0-4.el9.x86_64 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout: 2026-03-09T15:34:20.838 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:21.070 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: librbd1 2026-03-09T15:34:21.070 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:21.073 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:21.073 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:21.073 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:21.136 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: librbd1 2026-03-09T15:34:21.136 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:21.139 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:21.140 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:21.140 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:21.292 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: python3-rados 2026-03-09T15:34:21.292 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:21.294 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:21.295 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:21.295 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:21.375 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: python3-rados 2026-03-09T15:34:21.375 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:21.378 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:21.378 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:21.378 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:21.478 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: python3-rgw 2026-03-09T15:34:21.478 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:21.481 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:21.481 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:21.481 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:21.580 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: python3-rgw 2026-03-09T15:34:21.580 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:21.583 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:21.583 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:21.583 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:21.674 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: python3-cephfs 2026-03-09T15:34:21.674 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:21.677 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:21.677 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:21.677 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:21.774 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: python3-cephfs 2026-03-09T15:34:21.774 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:21.776 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:21.777 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:21.777 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:21.868 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: python3-rbd 2026-03-09T15:34:21.868 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:21.870 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:21.871 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:21.871 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:21.968 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: python3-rbd 2026-03-09T15:34:21.968 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:21.971 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:21.971 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:21.971 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:22.057 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: rbd-fuse 2026-03-09T15:34:22.057 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:22.059 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:22.060 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:22.060 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:22.170 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: rbd-fuse 2026-03-09T15:34:22.170 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:22.172 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:22.173 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:22.173 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:22.223 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: rbd-mirror 2026-03-09T15:34:22.223 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:22.226 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:22.227 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:22.227 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:22.363 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: rbd-mirror 2026-03-09T15:34:22.363 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:22.365 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:22.366 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:22.366 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:22.383 INFO:teuthology.orchestra.run.vm04.stdout:No match for argument: rbd-nbd 2026-03-09T15:34:22.383 INFO:teuthology.orchestra.run.vm04.stderr:No packages marked for removal. 2026-03-09T15:34:22.385 INFO:teuthology.orchestra.run.vm04.stdout:Dependencies resolved. 2026-03-09T15:34:22.385 INFO:teuthology.orchestra.run.vm04.stdout:Nothing to do. 2026-03-09T15:34:22.386 INFO:teuthology.orchestra.run.vm04.stdout:Complete! 2026-03-09T15:34:22.405 DEBUG:teuthology.orchestra.run.vm04:> sudo yum clean all 2026-03-09T15:34:22.539 INFO:teuthology.orchestra.run.vm04.stdout:56 files removed 2026-03-09T15:34:22.560 DEBUG:teuthology.orchestra.run.vm04:> sudo rm -f /etc/yum.repos.d/ceph.repo 2026-03-09T15:34:22.564 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: rbd-nbd 2026-03-09T15:34:22.565 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T15:34:22.567 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T15:34:22.568 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T15:34:22.568 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T15:34:22.585 DEBUG:teuthology.orchestra.run.vm04:> sudo yum clean expire-cache 2026-03-09T15:34:22.597 DEBUG:teuthology.orchestra.run.vm03:> sudo yum clean all 2026-03-09T15:34:22.752 INFO:teuthology.orchestra.run.vm04.stdout:Cache was expired 2026-03-09T15:34:22.752 INFO:teuthology.orchestra.run.vm04.stdout:0 files removed 2026-03-09T15:34:22.752 INFO:teuthology.orchestra.run.vm03.stdout:56 files removed 2026-03-09T15:34:22.780 DEBUG:teuthology.parallel:result is None 2026-03-09T15:34:22.793 DEBUG:teuthology.orchestra.run.vm03:> sudo rm -f /etc/yum.repos.d/ceph.repo 2026-03-09T15:34:22.818 DEBUG:teuthology.orchestra.run.vm03:> sudo yum clean expire-cache 2026-03-09T15:34:22.989 INFO:teuthology.orchestra.run.vm03.stdout:Cache was expired 2026-03-09T15:34:22.989 INFO:teuthology.orchestra.run.vm03.stdout:0 files removed 2026-03-09T15:34:23.006 DEBUG:teuthology.parallel:result is None 2026-03-09T15:34:23.006 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@vm03.local 2026-03-09T15:34:23.006 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@vm04.local 2026-03-09T15:34:23.006 DEBUG:teuthology.orchestra.run.vm03:> sudo rm -f /etc/yum.repos.d/ceph.repo 2026-03-09T15:34:23.007 DEBUG:teuthology.orchestra.run.vm04:> sudo rm -f /etc/yum.repos.d/ceph.repo 2026-03-09T15:34:23.031 DEBUG:teuthology.orchestra.run.vm03:> sudo mv -f /etc/yum/pluginconf.d/priorities.conf.orig /etc/yum/pluginconf.d/priorities.conf 2026-03-09T15:34:23.039 DEBUG:teuthology.orchestra.run.vm04:> sudo mv -f /etc/yum/pluginconf.d/priorities.conf.orig /etc/yum/pluginconf.d/priorities.conf 2026-03-09T15:34:23.093 DEBUG:teuthology.parallel:result is None 2026-03-09T15:34:23.107 DEBUG:teuthology.parallel:result is None 2026-03-09T15:34:23.107 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-03-09T15:34:23.109 INFO:teuthology.task.clock:Checking final clock skew... 2026-03-09T15:34:23.109 DEBUG:teuthology.orchestra.run.vm03:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-09T15:34:23.135 DEBUG:teuthology.orchestra.run.vm04:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-09T15:34:23.151 INFO:teuthology.orchestra.run.vm03.stderr:bash: line 1: ntpq: command not found 2026-03-09T15:34:23.165 INFO:teuthology.orchestra.run.vm04.stderr:bash: line 1: ntpq: command not found 2026-03-09T15:34:23.320 INFO:teuthology.orchestra.run.vm04.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-09T15:34:23.320 INFO:teuthology.orchestra.run.vm04.stdout:=============================================================================== 2026-03-09T15:34:23.320 INFO:teuthology.orchestra.run.vm04.stdout:^- mail.sassmann.nrw 2 6 377 10 -846us[ -846us] +/- 34ms 2026-03-09T15:34:23.320 INFO:teuthology.orchestra.run.vm04.stdout:^+ 141.144.246.224 2 6 377 12 -445us[ -445us] +/- 15ms 2026-03-09T15:34:23.321 INFO:teuthology.orchestra.run.vm04.stdout:^- sonne.floppy.org 2 6 377 11 -1286us[-1286us] +/- 50ms 2026-03-09T15:34:23.321 INFO:teuthology.orchestra.run.vm04.stdout:^* ntp3.rrze.uni-erlangen.de 1 6 377 12 +375us[ +636us] +/- 14ms 2026-03-09T15:34:23.321 INFO:teuthology.orchestra.run.vm03.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-09T15:34:23.321 INFO:teuthology.orchestra.run.vm03.stdout:=============================================================================== 2026-03-09T15:34:23.321 INFO:teuthology.orchestra.run.vm03.stdout:^+ mail.sassmann.nrw 2 6 377 12 -571us[ -514us] +/- 34ms 2026-03-09T15:34:23.321 INFO:teuthology.orchestra.run.vm03.stdout:^- sonne.floppy.org 2 6 377 12 -902us[ -845us] +/- 50ms 2026-03-09T15:34:23.321 INFO:teuthology.orchestra.run.vm03.stdout:^+ 141.144.246.224 2 6 377 11 -226us[ -169us] +/- 15ms 2026-03-09T15:34:23.321 INFO:teuthology.orchestra.run.vm03.stdout:^* ntp3.rrze.uni-erlangen.de 1 6 377 11 +499us[ +556us] +/- 14ms 2026-03-09T15:34:23.321 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-03-09T15:34:23.323 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-03-09T15:34:23.324 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-03-09T15:34:23.326 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-03-09T15:34:23.328 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-03-09T15:34:23.329 INFO:teuthology.task.internal:Duration was 387.675108 seconds 2026-03-09T15:34:23.330 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-03-09T15:34:23.332 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-03-09T15:34:23.332 DEBUG:teuthology.orchestra.run.vm03:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-03-09T15:34:23.364 DEBUG:teuthology.orchestra.run.vm04:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-03-09T15:34:23.407 INFO:teuthology.orchestra.run.vm03.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-09T15:34:23.411 INFO:teuthology.orchestra.run.vm04.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-09T15:34:23.907 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-03-09T15:34:23.907 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@vm03.local 2026-03-09T15:34:23.908 DEBUG:teuthology.orchestra.run.vm03:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-03-09T15:34:23.937 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@vm04.local 2026-03-09T15:34:23.937 DEBUG:teuthology.orchestra.run.vm04:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-03-09T15:34:23.967 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-03-09T15:34:23.967 DEBUG:teuthology.orchestra.run.vm03:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-03-09T15:34:23.980 DEBUG:teuthology.orchestra.run.vm04:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-03-09T15:34:24.422 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-03-09T15:34:24.422 DEBUG:teuthology.orchestra.run.vm03:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-03-09T15:34:24.424 DEBUG:teuthology.orchestra.run.vm04:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-03-09T15:34:24.450 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-09T15:34:24.450 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-09T15:34:24.451 INFO:teuthology.orchestra.run.vm03.stderr:gzip/home/ubuntu/cephtest/archive/syslog/kern.log: -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-03-09T15:34:24.451 INFO:teuthology.orchestra.run.vm03.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-03-09T15:34:24.451 INFO:teuthology.orchestra.run.vm03.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-03-09T15:34:24.452 INFO:teuthology.orchestra.run.vm04.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-09T15:34:24.452 INFO:teuthology.orchestra.run.vm04.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-09T15:34:24.452 INFO:teuthology.orchestra.run.vm04.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-03-09T15:34:24.452 INFO:teuthology.orchestra.run.vm04.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-03-09T15:34:24.452 INFO:teuthology.orchestra.run.vm04.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/journalctl.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-03-09T15:34:24.583 INFO:teuthology.orchestra.run.vm04.stderr: 98.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-03-09T15:34:24.598 INFO:teuthology.orchestra.run.vm03.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 98.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-03-09T15:34:24.600 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-03-09T15:34:24.603 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-03-09T15:34:24.603 DEBUG:teuthology.orchestra.run.vm03:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-03-09T15:34:24.668 DEBUG:teuthology.orchestra.run.vm04:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-03-09T15:34:24.696 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-03-09T15:34:24.699 DEBUG:teuthology.orchestra.run.vm03:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-03-09T15:34:24.711 DEBUG:teuthology.orchestra.run.vm04:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-03-09T15:34:24.736 INFO:teuthology.orchestra.run.vm03.stdout:kernel.core_pattern = core 2026-03-09T15:34:24.766 INFO:teuthology.orchestra.run.vm04.stdout:kernel.core_pattern = core 2026-03-09T15:34:24.781 DEBUG:teuthology.orchestra.run.vm03:> test -e /home/ubuntu/cephtest/archive/coredump 2026-03-09T15:34:24.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T15:34:24.806 DEBUG:teuthology.orchestra.run.vm04:> test -e /home/ubuntu/cephtest/archive/coredump 2026-03-09T15:34:24.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T15:34:24.837 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-03-09T15:34:24.840 INFO:teuthology.task.internal:Transferring archived files... 2026-03-09T15:34:24.840 DEBUG:teuthology.misc:Transferring archived files from vm03:/home/ubuntu/cephtest/archive to /archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/526/remote/vm03 2026-03-09T15:34:24.841 DEBUG:teuthology.orchestra.run.vm03:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-03-09T15:34:24.875 DEBUG:teuthology.misc:Transferring archived files from vm04:/home/ubuntu/cephtest/archive to /archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/526/remote/vm04 2026-03-09T15:34:24.875 DEBUG:teuthology.orchestra.run.vm04:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-03-09T15:34:24.905 INFO:teuthology.task.internal:Removing archive directory... 2026-03-09T15:34:24.905 DEBUG:teuthology.orchestra.run.vm03:> rm -rf -- /home/ubuntu/cephtest/archive 2026-03-09T15:34:24.916 DEBUG:teuthology.orchestra.run.vm04:> rm -rf -- /home/ubuntu/cephtest/archive 2026-03-09T15:34:24.961 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-03-09T15:34:24.964 INFO:teuthology.task.internal:Not uploading archives. 2026-03-09T15:34:24.964 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-03-09T15:34:24.966 INFO:teuthology.task.internal:Tidying up after the test... 2026-03-09T15:34:24.966 DEBUG:teuthology.orchestra.run.vm03:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-03-09T15:34:24.971 DEBUG:teuthology.orchestra.run.vm04:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-03-09T15:34:24.990 INFO:teuthology.orchestra.run.vm03.stdout: 8532145 0 drwxr-xr-x 2 ubuntu ubuntu 6 Mar 9 15:34 /home/ubuntu/cephtest 2026-03-09T15:34:25.017 INFO:teuthology.orchestra.run.vm04.stdout: 8532146 0 drwxr-xr-x 2 ubuntu ubuntu 6 Mar 9 15:34 /home/ubuntu/cephtest 2026-03-09T15:34:25.017 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-03-09T15:34:25.023 INFO:teuthology.run:Summary data: description: orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_ca_signed_key} duration: 387.67510771751404 flavor: default owner: kyr success: true 2026-03-09T15:34:25.023 DEBUG:teuthology.report:Pushing job info to http://localhost:8080 2026-03-09T15:34:25.042 INFO:teuthology.run:pass