2026-03-09T00:25:20.687 INFO:root:teuthology version: 1.2.4.dev6+g1c580df7a 2026-03-09T00:25:20.692 DEBUG:teuthology.report:Pushing job info to http://localhost:8080 2026-03-09T00:25:20.715 INFO:teuthology.run:Config: archive_path: /archive/kyr-2026-03-08_22:22:45-orch:cephadm-squid-none-default-vps/313 branch: squid description: orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} email: null first_in_suite: false flavor: default job_id: '313' last_in_suite: false machine_type: vps name: kyr-2026-03-08_22:22:45-orch:cephadm-squid-none-default-vps no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ansible.cephlab: branch: main skip_tags: nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs vars: timezone: UTC ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: false mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd mclock iops capacity threshold hdd: 49000 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - CEPHADM_FAILED_DAEMON log-only-match: - CEPHADM_ sha1: e911bdebe5c8faa3800735d1568fcdca65db60df ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: e911bdebe5c8faa3800735d1568fcdca65db60df extra_system_packages: deb: - python3-xmltodict - python3-jmespath rpm: - bzip2 - perl-Test-Harness - python3-xmltodict - python3-jmespath selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 workunit: branch: tt-squid sha1: 569c3e99c9b32a51b4eaf08731c728f4513ed589 owner: kyr priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - host.a - osd.0 - osd.1 - osd.2 - mon.a - mgr.a - client.0 seed: 8017 sha1: e911bdebe5c8faa3800735d1568fcdca65db60df sleep_before_teardown: 0 subset: 1/64 suite: orch:cephadm suite_branch: tt-squid suite_path: /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa suite_relpath: qa suite_repo: https://github.com/kshtsk/ceph.git suite_sha1: 569c3e99c9b32a51b4eaf08731c728f4513ed589 targets: vm05.local: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHoPwgonk1USIPUYRPe4Ej00jIiD8XavXe2KfLCkJURjGQGkVrrtqEzNIurG0yJHGpLb7rIS/a8hqeq5azHLX14= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install runc nvmetcli nvme-cli -y - sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf - sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf - install: null - cephadm: null - cephadm.shell: host.a: - ceph osd pool create foo - rbd pool init foo - ceph orch apply iscsi foo u p - workunit: clients: client.0: - cephadm/test_iscsi_pids_limit.sh - cephadm/test_iscsi_etc_hosts.sh - cephadm/test_iscsi_setup.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: clyso-debian-13 teuthology_repo: https://github.com/clyso/teuthology teuthology_sha1: 1c580df7a9c7c2aadc272da296344fd99f27c444 timestamp: 2026-03-08_22:22:45 tube: vps user: kyr verbose: false worker_log: /home/teuthos/.teuthology/dispatcher/dispatcher.vps.611473 2026-03-09T00:25:20.715 INFO:teuthology.run:suite_path is set to /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa; will attempt to use it 2026-03-09T00:25:20.715 INFO:teuthology.run:Found tasks at /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa/tasks 2026-03-09T00:25:20.715 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-03-09T00:25:20.716 INFO:teuthology.task.internal:Checking packages... 2026-03-09T00:25:20.716 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e911bdebe5c8faa3800735d1568fcdca65db60df' 2026-03-09T00:25:20.716 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-03-09T00:25:20.716 INFO:teuthology.packaging:ref: None 2026-03-09T00:25:20.716 INFO:teuthology.packaging:tag: None 2026-03-09T00:25:20.716 INFO:teuthology.packaging:branch: squid 2026-03-09T00:25:20.716 INFO:teuthology.packaging:sha1: e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:25:20.716 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2026-03-09T00:25:21.579 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-678.ge911bdeb 2026-03-09T00:25:21.580 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-03-09T00:25:21.581 INFO:teuthology.task.internal:no buildpackages task found 2026-03-09T00:25:21.581 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-03-09T00:25:21.582 INFO:teuthology.task.internal:Saving configuration 2026-03-09T00:25:21.587 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-03-09T00:25:21.588 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-03-09T00:25:21.596 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'vm05.local', 'description': '/archive/kyr-2026-03-08_22:22:45-orch:cephadm-squid-none-default-vps/313', 'up': True, 'machine_type': 'vps', 'is_vm': True, 'vm_host': {'name': 'localhost', 'description': None, 'up': True, 'machine_type': 'libvirt', 'is_vm': False, 'vm_host': None, 'os_type': None, 'os_version': None, 'arch': None, 'locked': True, 'locked_since': None, 'locked_by': None, 'mac_address': None, 'ssh_pub_key': None}, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-03-09 00:24:38.190271', 'locked_by': 'kyr', 'mac_address': '52:55:00:00:00:05', 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHoPwgonk1USIPUYRPe4Ej00jIiD8XavXe2KfLCkJURjGQGkVrrtqEzNIurG0yJHGpLb7rIS/a8hqeq5azHLX14='} 2026-03-09T00:25:21.596 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-03-09T00:25:21.596 INFO:teuthology.task.internal:roles: ubuntu@vm05.local - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0'] 2026-03-09T00:25:21.597 INFO:teuthology.run_tasks:Running task console_log... 2026-03-09T00:25:21.605 DEBUG:teuthology.task.console_log:vm05 does not support IPMI; excluding 2026-03-09T00:25:21.605 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f79603d0e50>, signals=[15]) 2026-03-09T00:25:21.605 INFO:teuthology.run_tasks:Running task internal.connect... 2026-03-09T00:25:21.606 INFO:teuthology.task.internal:Opening connections... 2026-03-09T00:25:21.606 DEBUG:teuthology.task.internal:connecting to ubuntu@vm05.local 2026-03-09T00:25:21.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm05.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-09T00:25:21.670 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-03-09T00:25:21.672 DEBUG:teuthology.orchestra.run.vm05:> uname -m 2026-03-09T00:25:21.845 INFO:teuthology.orchestra.run.vm05.stdout:x86_64 2026-03-09T00:25:21.846 DEBUG:teuthology.orchestra.run.vm05:> cat /etc/os-release 2026-03-09T00:25:21.905 INFO:teuthology.orchestra.run.vm05.stdout:NAME="CentOS Stream" 2026-03-09T00:25:21.905 INFO:teuthology.orchestra.run.vm05.stdout:VERSION="9" 2026-03-09T00:25:21.905 INFO:teuthology.orchestra.run.vm05.stdout:ID="centos" 2026-03-09T00:25:21.905 INFO:teuthology.orchestra.run.vm05.stdout:ID_LIKE="rhel fedora" 2026-03-09T00:25:21.905 INFO:teuthology.orchestra.run.vm05.stdout:VERSION_ID="9" 2026-03-09T00:25:21.905 INFO:teuthology.orchestra.run.vm05.stdout:PLATFORM_ID="platform:el9" 2026-03-09T00:25:21.905 INFO:teuthology.orchestra.run.vm05.stdout:PRETTY_NAME="CentOS Stream 9" 2026-03-09T00:25:21.905 INFO:teuthology.orchestra.run.vm05.stdout:ANSI_COLOR="0;31" 2026-03-09T00:25:21.905 INFO:teuthology.orchestra.run.vm05.stdout:LOGO="fedora-logo-icon" 2026-03-09T00:25:21.905 INFO:teuthology.orchestra.run.vm05.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-03-09T00:25:21.905 INFO:teuthology.orchestra.run.vm05.stdout:HOME_URL="https://centos.org/" 2026-03-09T00:25:21.905 INFO:teuthology.orchestra.run.vm05.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-03-09T00:25:21.905 INFO:teuthology.orchestra.run.vm05.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-03-09T00:25:21.905 INFO:teuthology.orchestra.run.vm05.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-03-09T00:25:21.905 INFO:teuthology.lock.ops:Updating vm05.local on lock server 2026-03-09T00:25:21.910 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-03-09T00:25:21.912 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-03-09T00:25:21.913 INFO:teuthology.task.internal:Checking for old test directory... 2026-03-09T00:25:21.913 DEBUG:teuthology.orchestra.run.vm05:> test '!' -e /home/ubuntu/cephtest 2026-03-09T00:25:21.961 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-03-09T00:25:21.962 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-03-09T00:25:21.963 DEBUG:teuthology.orchestra.run.vm05:> test -z $(ls -A /var/lib/ceph) 2026-03-09T00:25:22.017 INFO:teuthology.orchestra.run.vm05.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-03-09T00:25:22.017 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-03-09T00:25:22.025 DEBUG:teuthology.orchestra.run.vm05:> test -e /ceph-qa-ready 2026-03-09T00:25:22.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T00:25:22.278 INFO:teuthology.run_tasks:Running task internal.base... 2026-03-09T00:25:22.279 INFO:teuthology.task.internal:Creating test directory... 2026-03-09T00:25:22.279 DEBUG:teuthology.orchestra.run.vm05:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-03-09T00:25:22.295 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-03-09T00:25:22.296 INFO:teuthology.run_tasks:Running task internal.archive... 2026-03-09T00:25:22.297 INFO:teuthology.task.internal:Creating archive directory... 2026-03-09T00:25:22.298 DEBUG:teuthology.orchestra.run.vm05:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-03-09T00:25:22.356 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-03-09T00:25:22.358 INFO:teuthology.task.internal:Enabling coredump saving... 2026-03-09T00:25:22.358 DEBUG:teuthology.orchestra.run.vm05:> test -f /run/.containerenv -o -f /.dockerenv 2026-03-09T00:25:22.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T00:25:22.415 DEBUG:teuthology.orchestra.run.vm05:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-03-09T00:25:22.480 INFO:teuthology.orchestra.run.vm05.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-09T00:25:22.491 INFO:teuthology.orchestra.run.vm05.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-09T00:25:22.493 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-03-09T00:25:22.494 INFO:teuthology.task.internal:Configuring sudo... 2026-03-09T00:25:22.495 DEBUG:teuthology.orchestra.run.vm05:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-03-09T00:25:22.561 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-03-09T00:25:22.564 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-03-09T00:25:22.565 DEBUG:teuthology.orchestra.run.vm05:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-03-09T00:25:22.620 DEBUG:teuthology.orchestra.run.vm05:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-09T00:25:22.686 DEBUG:teuthology.orchestra.run.vm05:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-09T00:25:22.743 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:25:22.743 DEBUG:teuthology.orchestra.run.vm05:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-03-09T00:25:22.804 DEBUG:teuthology.orchestra.run.vm05:> sudo service rsyslog restart 2026-03-09T00:25:22.873 INFO:teuthology.orchestra.run.vm05.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-09T00:25:23.318 INFO:teuthology.run_tasks:Running task internal.timer... 2026-03-09T00:25:23.320 INFO:teuthology.task.internal:Starting timer... 2026-03-09T00:25:23.320 INFO:teuthology.run_tasks:Running task pcp... 2026-03-09T00:25:23.323 INFO:teuthology.run_tasks:Running task selinux... 2026-03-09T00:25:23.325 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-03-09T00:25:23.325 INFO:teuthology.task.selinux:Excluding vm05: VMs are not yet supported 2026-03-09T00:25:23.326 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-03-09T00:25:23.326 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-03-09T00:25:23.326 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-03-09T00:25:23.326 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-03-09T00:25:23.327 DEBUG:teuthology.task:Applying overrides for task ansible.cephlab: {'branch': 'main', 'skip_tags': 'nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs', 'vars': {'timezone': 'UTC'}} 2026-03-09T00:25:23.327 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthos/src/github.com_ceph_ceph-cm-ansible_main to origin/main 2026-03-09T00:25:23.333 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-03-09T00:25:23.333 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu", "timezone": "UTC"}' -i /tmp/teuth_ansible_inventoryhau00r_j --limit vm05.local /home/teuthos/src/github.com_ceph_ceph-cm-ansible_main/cephlab.yml --skip-tags nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs 2026-03-09T00:27:21.675 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@vm05.local')] 2026-03-09T00:27:21.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@vm05.local' 2026-03-09T00:27:21.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm05.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-09T00:27:21.741 DEBUG:teuthology.orchestra.run.vm05:> true 2026-03-09T00:27:21.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@vm05.local' 2026-03-09T00:27:21.825 INFO:teuthology.run_tasks:Running task clock... 2026-03-09T00:27:21.828 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-03-09T00:27:21.828 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-03-09T00:27:21.828 DEBUG:teuthology.orchestra.run.vm05:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-09T00:27:21.915 INFO:teuthology.orchestra.run.vm05.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-03-09T00:27:21.937 INFO:teuthology.orchestra.run.vm05.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-03-09T00:27:21.970 INFO:teuthology.orchestra.run.vm05.stderr:sudo: ntpd: command not found 2026-03-09T00:27:21.986 INFO:teuthology.orchestra.run.vm05.stdout:506 Cannot talk to daemon 2026-03-09T00:27:22.006 INFO:teuthology.orchestra.run.vm05.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-03-09T00:27:22.023 INFO:teuthology.orchestra.run.vm05.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-03-09T00:27:22.083 INFO:teuthology.orchestra.run.vm05.stderr:bash: line 1: ntpq: command not found 2026-03-09T00:27:22.085 INFO:teuthology.orchestra.run.vm05.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-09T00:27:22.085 INFO:teuthology.orchestra.run.vm05.stdout:=============================================================================== 2026-03-09T00:27:22.086 INFO:teuthology.run_tasks:Running task pexec... 2026-03-09T00:27:22.088 INFO:teuthology.task.pexec:Executing custom commands... 2026-03-09T00:27:22.088 DEBUG:teuthology.orchestra.run.vm05:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-03-09T00:27:22.089 DEBUG:teuthology.task.pexec:ubuntu@vm05.local< sudo dnf remove nvme-cli -y 2026-03-09T00:27:22.090 DEBUG:teuthology.task.pexec:ubuntu@vm05.local< sudo dnf install runc nvmetcli nvme-cli -y 2026-03-09T00:27:22.090 DEBUG:teuthology.task.pexec:ubuntu@vm05.local< sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf 2026-03-09T00:27:22.090 DEBUG:teuthology.task.pexec:ubuntu@vm05.local< sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf 2026-03-09T00:27:22.090 INFO:teuthology.task.pexec:Running commands on host ubuntu@vm05.local 2026-03-09T00:27:22.090 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-03-09T00:27:22.090 INFO:teuthology.task.pexec:sudo dnf install runc nvmetcli nvme-cli -y 2026-03-09T00:27:22.090 INFO:teuthology.task.pexec:sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf 2026-03-09T00:27:22.090 INFO:teuthology.task.pexec:sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf 2026-03-09T00:27:22.326 INFO:teuthology.orchestra.run.vm05.stdout:No match for argument: nvme-cli 2026-03-09T00:27:22.329 INFO:teuthology.orchestra.run.vm05.stderr:No packages marked for removal. 2026-03-09T00:27:22.332 INFO:teuthology.orchestra.run.vm05.stdout:Dependencies resolved. 2026-03-09T00:27:22.333 INFO:teuthology.orchestra.run.vm05.stdout:Nothing to do. 2026-03-09T00:27:22.333 INFO:teuthology.orchestra.run.vm05.stdout:Complete! 2026-03-09T00:27:22.926 INFO:teuthology.orchestra.run.vm05.stdout:Last metadata expiration check: 0:01:11 ago on Mon 09 Mar 2026 12:26:11 AM UTC. 2026-03-09T00:27:23.063 INFO:teuthology.orchestra.run.vm05.stdout:Dependencies resolved. 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout:================================================================================ 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout: Package Arch Version Repository Size 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout:================================================================================ 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout:Installing: 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout: runc x86_64 4:1.4.0-2.el9 appstream 4.0 M 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout:Installing dependencies: 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout:Transaction Summary 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout:================================================================================ 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout:Install 7 Packages 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout:Total download size: 6.3 M 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout:Installed size: 24 M 2026-03-09T00:27:23.064 INFO:teuthology.orchestra.run.vm05.stdout:Downloading Packages: 2026-03-09T00:27:23.593 INFO:teuthology.orchestra.run.vm05.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 159 kB/s | 44 kB 00:00 2026-03-09T00:27:23.620 INFO:teuthology.orchestra.run.vm05.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 237 kB/s | 72 kB 00:00 2026-03-09T00:27:23.731 INFO:teuthology.orchestra.run.vm05.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 611 kB/s | 84 kB 00:00 2026-03-09T00:27:23.758 INFO:teuthology.orchestra.run.vm05.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 1.1 MB/s | 150 kB 00:00 2026-03-09T00:27:23.853 INFO:teuthology.orchestra.run.vm05.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 2.1 MB/s | 1.2 MB 00:00 2026-03-09T00:27:23.934 INFO:teuthology.orchestra.run.vm05.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 4.0 MB/s | 837 kB 00:00 2026-03-09T00:27:24.534 INFO:teuthology.orchestra.run.vm05.stdout:(7/7): runc-1.4.0-2.el9.x86_64.rpm 5.1 MB/s | 4.0 MB 00:00 2026-03-09T00:27:24.534 INFO:teuthology.orchestra.run.vm05.stdout:-------------------------------------------------------------------------------- 2026-03-09T00:27:24.534 INFO:teuthology.orchestra.run.vm05.stdout:Total 4.3 MB/s | 6.3 MB 00:01 2026-03-09T00:27:24.640 INFO:teuthology.orchestra.run.vm05.stdout:Running transaction check 2026-03-09T00:27:24.646 INFO:teuthology.orchestra.run.vm05.stdout:Transaction check succeeded. 2026-03-09T00:27:24.646 INFO:teuthology.orchestra.run.vm05.stdout:Running transaction test 2026-03-09T00:27:24.735 INFO:teuthology.orchestra.run.vm05.stdout:Transaction test succeeded. 2026-03-09T00:27:24.735 INFO:teuthology.orchestra.run.vm05.stdout:Running transaction 2026-03-09T00:27:24.939 INFO:teuthology.orchestra.run.vm05.stdout: Preparing : 1/1 2026-03-09T00:27:24.954 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/7 2026-03-09T00:27:24.969 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 2/7 2026-03-09T00:27:24.978 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-03-09T00:27:24.987 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/7 2026-03-09T00:27:24.989 INFO:teuthology.orchestra.run.vm05.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/7 2026-03-09T00:27:25.060 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/7 2026-03-09T00:27:25.228 INFO:teuthology.orchestra.run.vm05.stdout: Installing : runc-4:1.4.0-2.el9.x86_64 6/7 2026-03-09T00:27:25.232 INFO:teuthology.orchestra.run.vm05.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/7 2026-03-09T00:27:25.642 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/7 2026-03-09T00:27:25.642 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-03-09T00:27:25.642 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:27:26.409 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/7 2026-03-09T00:27:26.410 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/7 2026-03-09T00:27:26.410 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-03-09T00:27:26.410 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/7 2026-03-09T00:27:26.410 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/7 2026-03-09T00:27:26.410 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/7 2026-03-09T00:27:26.757 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : runc-4:1.4.0-2.el9.x86_64 7/7 2026-03-09T00:27:26.757 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:27:26.757 INFO:teuthology.orchestra.run.vm05.stdout:Installed: 2026-03-09T00:27:26.757 INFO:teuthology.orchestra.run.vm05.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-03-09T00:27:26.757 INFO:teuthology.orchestra.run.vm05.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-03-09T00:27:26.758 INFO:teuthology.orchestra.run.vm05.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-03-09T00:27:26.758 INFO:teuthology.orchestra.run.vm05.stdout: runc-4:1.4.0-2.el9.x86_64 2026-03-09T00:27:26.758 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:27:26.758 INFO:teuthology.orchestra.run.vm05.stdout:Complete! 2026-03-09T00:27:27.084 DEBUG:teuthology.parallel:result is None 2026-03-09T00:27:27.084 INFO:teuthology.run_tasks:Running task install... 2026-03-09T00:27:27.086 DEBUG:teuthology.task.install:project ceph 2026-03-09T00:27:27.086 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df'}, 'extra_system_packages': {'deb': ['python3-xmltodict', 'python3-jmespath'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 'python3-jmespath']}} 2026-03-09T00:27:27.086 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df', 'extra_system_packages': {'deb': ['python3-xmltodict', 'python3-jmespath'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 'python3-jmespath']}} 2026-03-09T00:27:27.086 INFO:teuthology.task.install:Using flavor: default 2026-03-09T00:27:27.088 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-03-09T00:27:27.088 INFO:teuthology.task.install:extra packages: [] 2026-03-09T00:27:27.088 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['python3-xmltodict', 'python3-jmespath'], 'rpm': ['bzip2', 'perl-Test-Harness', 'python3-xmltodict', 'python3-jmespath']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df', 'tag': None, 'wait_for_package': False} 2026-03-09T00:27:27.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:27:27.758 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/ 2026-03-09T00:27:27.759 INFO:teuthology.task.install.rpm:Package version is 19.2.3-678.ge911bdeb 2026-03-09T00:27:28.263 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-03-09T00:27:28.263 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:27:28.263 DEBUG:teuthology.orchestra.run.vm05:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-03-09T00:27:28.299 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bzip2, perl-Test-Harness, python3-xmltodict, python3-jmespath on remote rpm x86_64 2026-03-09T00:27:28.299 DEBUG:teuthology.orchestra.run.vm05:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e911bdebe5c8faa3800735d1568fcdca65db60df/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-03-09T00:27:28.369 DEBUG:teuthology.orchestra.run.vm05:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-03-09T00:27:28.457 DEBUG:teuthology.orchestra.run.vm05:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-03-09T00:27:28.485 INFO:teuthology.orchestra.run.vm05.stdout:check_obsoletes = 1 2026-03-09T00:27:28.486 DEBUG:teuthology.orchestra.run.vm05:> sudo yum clean all 2026-03-09T00:27:28.716 INFO:teuthology.orchestra.run.vm05.stdout:41 files removed 2026-03-09T00:27:28.748 DEBUG:teuthology.orchestra.run.vm05:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bzip2 perl-Test-Harness python3-xmltodict python3-jmespath 2026-03-09T00:27:30.216 INFO:teuthology.orchestra.run.vm05.stdout:ceph packages for x86_64 67 kB/s | 84 kB 00:01 2026-03-09T00:27:31.189 INFO:teuthology.orchestra.run.vm05.stdout:ceph noarch packages 12 kB/s | 12 kB 00:00 2026-03-09T00:27:32.151 INFO:teuthology.orchestra.run.vm05.stdout:ceph source packages 2.0 kB/s | 1.9 kB 00:00 2026-03-09T00:27:34.276 INFO:teuthology.orchestra.run.vm05.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.9 MB 00:02 2026-03-09T00:27:37.360 INFO:teuthology.orchestra.run.vm05.stdout:CentOS Stream 9 - AppStream 12 MB/s | 27 MB 00:02 2026-03-09T00:27:41.803 INFO:teuthology.orchestra.run.vm05.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 8.0 MB 00:00 2026-03-09T00:27:43.559 INFO:teuthology.orchestra.run.vm05.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 20 kB 00:00 2026-03-09T00:27:44.294 INFO:teuthology.orchestra.run.vm05.stdout:Extra Packages for Enterprise Linux 32 MB/s | 20 MB 00:00 2026-03-09T00:27:49.075 INFO:teuthology.orchestra.run.vm05.stdout:lab-extras 64 kB/s | 50 kB 00:00 2026-03-09T00:27:50.487 INFO:teuthology.orchestra.run.vm05.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-03-09T00:27:50.488 INFO:teuthology.orchestra.run.vm05.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-03-09T00:27:50.492 INFO:teuthology.orchestra.run.vm05.stdout:Package bzip2-1.0.8-11.el9.x86_64 is already installed. 2026-03-09T00:27:50.492 INFO:teuthology.orchestra.run.vm05.stdout:Package perl-Test-Harness-1:3.42-461.el9.noarch is already installed. 2026-03-09T00:27:50.520 INFO:teuthology.orchestra.run.vm05.stdout:Dependencies resolved. 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout:====================================================================================== 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: Package Arch Version Repository Size 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout:====================================================================================== 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout:Installing: 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: ceph x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 6.5 k 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: ceph-base x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 5.5 M 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: ceph-fuse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.2 M 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 145 k 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mgr x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.1 M 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mgr-cephadm noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 150 k 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mgr-dashboard noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 3.8 M 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 7.4 M 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mgr-rook noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 49 k 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: ceph-radosgw x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 11 M 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: ceph-test x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 50 M 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: ceph-volume noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 299 k 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: cephadm noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 769 k 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: libcephfs-devel x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 34 k 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: libcephfs2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 1.0 M 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: librados-devel x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 127 k 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: python3-cephfs x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 165 k 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-03-09T00:27:50.524 INFO:teuthology.orchestra.run.vm05.stdout: python3-rados x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 323 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: python3-rbd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 303 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: python3-rgw x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 100 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: rbd-fuse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 85 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: rbd-mirror x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.1 M 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: rbd-nbd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 171 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout:Upgrading: 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: librados2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.4 M 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: librbd1 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 3.2 M 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout:Installing dependencies: 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: ceph-common x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 22 M 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: ceph-grafana-dashboards noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 31 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mds x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 2.4 M 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mgr-modules-core noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 253 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mon x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 4.7 M 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: ceph-osd x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 17 M 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: ceph-prometheus-alerts noarch 2:19.2.3-678.ge911bdeb.el9 ceph-noarch 17 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: ceph-selinux x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 25 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: libcephsqlite x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 163 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: libradosstriper1 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 503 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: librgw2 x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 5.4 M 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-03-09T00:27:50.525 INFO:teuthology.orchestra.run.vm05.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-ceph-argparse x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 45 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-ceph-common x86_64 2:19.2.3-678.ge911bdeb.el9 ceph 142 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout:Installing weak dependencies: 2026-03-09T00:27:50.526 INFO:teuthology.orchestra.run.vm05.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-03-09T00:27:50.527 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:27:50.527 INFO:teuthology.orchestra.run.vm05.stdout:Transaction Summary 2026-03-09T00:27:50.527 INFO:teuthology.orchestra.run.vm05.stdout:====================================================================================== 2026-03-09T00:27:50.527 INFO:teuthology.orchestra.run.vm05.stdout:Install 134 Packages 2026-03-09T00:27:50.527 INFO:teuthology.orchestra.run.vm05.stdout:Upgrade 2 Packages 2026-03-09T00:27:50.527 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:27:50.527 INFO:teuthology.orchestra.run.vm05.stdout:Total download size: 210 M 2026-03-09T00:27:50.527 INFO:teuthology.orchestra.run.vm05.stdout:Downloading Packages: 2026-03-09T00:27:51.462 INFO:teuthology.orchestra.run.vm05.stdout:(1/136): ceph-19.2.3-678.ge911bdeb.el9.x86_64.r 14 kB/s | 6.5 kB 00:00 2026-03-09T00:27:52.293 INFO:teuthology.orchestra.run.vm05.stdout:(2/136): ceph-fuse-19.2.3-678.ge911bdeb.el9.x86 1.4 MB/s | 1.2 MB 00:00 2026-03-09T00:27:52.413 INFO:teuthology.orchestra.run.vm05.stdout:(3/136): ceph-immutable-object-cache-19.2.3-678 1.2 MB/s | 145 kB 00:00 2026-03-09T00:27:52.692 INFO:teuthology.orchestra.run.vm05.stdout:(4/136): ceph-base-19.2.3-678.ge911bdeb.el9.x86 3.2 MB/s | 5.5 MB 00:01 2026-03-09T00:27:52.778 INFO:teuthology.orchestra.run.vm05.stdout:(5/136): ceph-mds-19.2.3-678.ge911bdeb.el9.x86_ 6.7 MB/s | 2.4 MB 00:00 2026-03-09T00:27:52.826 INFO:teuthology.orchestra.run.vm05.stdout:(6/136): ceph-mgr-19.2.3-678.ge911bdeb.el9.x86_ 8.1 MB/s | 1.1 MB 00:00 2026-03-09T00:27:53.390 INFO:teuthology.orchestra.run.vm05.stdout:(7/136): ceph-mon-19.2.3-678.ge911bdeb.el9.x86_ 7.7 MB/s | 4.7 MB 00:00 2026-03-09T00:27:54.000 INFO:teuthology.orchestra.run.vm05.stdout:(8/136): ceph-common-19.2.3-678.ge911bdeb.el9.x 7.2 MB/s | 22 MB 00:03 2026-03-09T00:27:54.117 INFO:teuthology.orchestra.run.vm05.stdout:(9/136): ceph-selinux-19.2.3-678.ge911bdeb.el9. 214 kB/s | 25 kB 00:00 2026-03-09T00:27:54.330 INFO:teuthology.orchestra.run.vm05.stdout:(10/136): ceph-osd-19.2.3-678.ge911bdeb.el9.x86 11 MB/s | 17 MB 00:01 2026-03-09T00:27:54.366 INFO:teuthology.orchestra.run.vm05.stdout:(11/136): ceph-radosgw-19.2.3-678.ge911bdeb.el9 11 MB/s | 11 MB 00:00 2026-03-09T00:27:54.450 INFO:teuthology.orchestra.run.vm05.stdout:(12/136): libcephfs-devel-19.2.3-678.ge911bdeb. 282 kB/s | 34 kB 00:00 2026-03-09T00:27:54.514 INFO:teuthology.orchestra.run.vm05.stdout:(13/136): libcephfs2-19.2.3-678.ge911bdeb.el9.x 6.6 MB/s | 1.0 MB 00:00 2026-03-09T00:27:54.571 INFO:teuthology.orchestra.run.vm05.stdout:(14/136): libcephsqlite-19.2.3-678.ge911bdeb.el 1.3 MB/s | 163 kB 00:00 2026-03-09T00:27:54.637 INFO:teuthology.orchestra.run.vm05.stdout:(15/136): librados-devel-19.2.3-678.ge911bdeb.e 1.0 MB/s | 127 kB 00:00 2026-03-09T00:27:54.696 INFO:teuthology.orchestra.run.vm05.stdout:(16/136): libradosstriper1-19.2.3-678.ge911bdeb 3.9 MB/s | 503 kB 00:00 2026-03-09T00:27:54.815 INFO:teuthology.orchestra.run.vm05.stdout:(17/136): python3-ceph-argparse-19.2.3-678.ge91 379 kB/s | 45 kB 00:00 2026-03-09T00:27:55.190 INFO:teuthology.orchestra.run.vm05.stdout:(18/136): python3-ceph-common-19.2.3-678.ge911b 381 kB/s | 142 kB 00:00 2026-03-09T00:27:55.337 INFO:teuthology.orchestra.run.vm05.stdout:(19/136): librgw2-19.2.3-678.ge911bdeb.el9.x86_ 7.7 MB/s | 5.4 MB 00:00 2026-03-09T00:27:55.339 INFO:teuthology.orchestra.run.vm05.stdout:(20/136): python3-cephfs-19.2.3-678.ge911bdeb.e 1.1 MB/s | 165 kB 00:00 2026-03-09T00:27:55.461 INFO:teuthology.orchestra.run.vm05.stdout:(21/136): python3-rados-19.2.3-678.ge911bdeb.el 2.5 MB/s | 323 kB 00:00 2026-03-09T00:27:55.463 INFO:teuthology.orchestra.run.vm05.stdout:(22/136): python3-rbd-19.2.3-678.ge911bdeb.el9. 2.4 MB/s | 303 kB 00:00 2026-03-09T00:27:55.585 INFO:teuthology.orchestra.run.vm05.stdout:(23/136): python3-rgw-19.2.3-678.ge911bdeb.el9. 808 kB/s | 100 kB 00:00 2026-03-09T00:27:55.586 INFO:teuthology.orchestra.run.vm05.stdout:(24/136): rbd-fuse-19.2.3-678.ge911bdeb.el9.x86 695 kB/s | 85 kB 00:00 2026-03-09T00:27:55.707 INFO:teuthology.orchestra.run.vm05.stdout:(25/136): rbd-nbd-19.2.3-678.ge911bdeb.el9.x86_ 1.4 MB/s | 171 kB 00:00 2026-03-09T00:27:55.826 INFO:teuthology.orchestra.run.vm05.stdout:(26/136): ceph-grafana-dashboards-19.2.3-678.ge 262 kB/s | 31 kB 00:00 2026-03-09T00:27:55.946 INFO:teuthology.orchestra.run.vm05.stdout:(27/136): ceph-mgr-cephadm-19.2.3-678.ge911bdeb 1.2 MB/s | 150 kB 00:00 2026-03-09T00:27:55.959 INFO:teuthology.orchestra.run.vm05.stdout:(28/136): rbd-mirror-19.2.3-678.ge911bdeb.el9.x 8.3 MB/s | 3.1 MB 00:00 2026-03-09T00:27:56.372 INFO:teuthology.orchestra.run.vm05.stdout:(29/136): ceph-mgr-dashboard-19.2.3-678.ge911bd 8.9 MB/s | 3.8 MB 00:00 2026-03-09T00:27:56.504 INFO:teuthology.orchestra.run.vm05.stdout:(30/136): ceph-mgr-diskprediction-local-19.2.3- 14 MB/s | 7.4 MB 00:00 2026-03-09T00:27:56.506 INFO:teuthology.orchestra.run.vm05.stdout:(31/136): ceph-mgr-modules-core-19.2.3-678.ge91 1.8 MB/s | 253 kB 00:00 2026-03-09T00:27:56.627 INFO:teuthology.orchestra.run.vm05.stdout:(32/136): ceph-mgr-rook-19.2.3-678.ge911bdeb.el 400 kB/s | 49 kB 00:00 2026-03-09T00:27:56.628 INFO:teuthology.orchestra.run.vm05.stdout:(33/136): ceph-prometheus-alerts-19.2.3-678.ge9 138 kB/s | 17 kB 00:00 2026-03-09T00:27:56.760 INFO:teuthology.orchestra.run.vm05.stdout:(34/136): cephadm-19.2.3-678.ge911bdeb.el9.noar 5.7 MB/s | 769 kB 00:00 2026-03-09T00:27:56.763 INFO:teuthology.orchestra.run.vm05.stdout:(35/136): ceph-volume-19.2.3-678.ge911bdeb.el9. 2.2 MB/s | 299 kB 00:00 2026-03-09T00:27:57.091 INFO:teuthology.orchestra.run.vm05.stdout:(36/136): ledmon-libs-1.1.0-3.el9.x86_64.rpm 123 kB/s | 40 kB 00:00 2026-03-09T00:27:57.214 INFO:teuthology.orchestra.run.vm05.stdout:(37/136): libconfig-1.7.2-9.el9.x86_64.rpm 589 kB/s | 72 kB 00:00 2026-03-09T00:27:57.224 INFO:teuthology.orchestra.run.vm05.stdout:(38/136): cryptsetup-2.8.1-3.el9.x86_64.rpm 757 kB/s | 351 kB 00:00 2026-03-09T00:27:57.307 INFO:teuthology.orchestra.run.vm05.stdout:(39/136): libquadmath-11.5.0-14.el9.x86_64.rpm 2.2 MB/s | 184 kB 00:00 2026-03-09T00:27:57.505 INFO:teuthology.orchestra.run.vm05.stdout:(40/136): ceph-test-19.2.3-678.ge911bdeb.el9.x8 15 MB/s | 50 MB 00:03 2026-03-09T00:27:57.507 INFO:teuthology.orchestra.run.vm05.stdout:(41/136): mailcap-2.1.49-5.el9.noarch.rpm 166 kB/s | 33 kB 00:00 2026-03-09T00:27:57.509 INFO:teuthology.orchestra.run.vm05.stdout:(42/136): libgfortran-11.5.0-14.el9.x86_64.rpm 2.6 MB/s | 794 kB 00:00 2026-03-09T00:27:57.755 INFO:teuthology.orchestra.run.vm05.stdout:(43/136): python3-cryptography-36.0.1-5.el9.x86 5.1 MB/s | 1.2 MB 00:00 2026-03-09T00:27:57.850 INFO:teuthology.orchestra.run.vm05.stdout:(44/136): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2026-03-09T00:27:57.974 INFO:teuthology.orchestra.run.vm05.stdout:(45/136): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2026-03-09T00:27:58.017 INFO:teuthology.orchestra.run.vm05.stdout:(46/136): pciutils-3.7.0-7.el9.x86_64.rpm 182 kB/s | 93 kB 00:00 2026-03-09T00:27:58.072 INFO:teuthology.orchestra.run.vm05.stdout:(47/136): python3-requests-2.25.1-10.el9.noarch 1.3 MB/s | 126 kB 00:00 2026-03-09T00:27:58.225 INFO:teuthology.orchestra.run.vm05.stdout:(48/136): unzip-6.0-59.el9.x86_64.rpm 1.2 MB/s | 182 kB 00:00 2026-03-09T00:27:58.394 INFO:teuthology.orchestra.run.vm05.stdout:(49/136): zip-3.0-35.el9.x86_64.rpm 1.5 MB/s | 266 kB 00:00 2026-03-09T00:27:58.597 INFO:teuthology.orchestra.run.vm05.stdout:(50/136): boost-program-options-1.75.0-13.el9.x 514 kB/s | 104 kB 00:00 2026-03-09T00:27:58.644 INFO:teuthology.orchestra.run.vm05.stdout:(51/136): flexiblas-3.0.4-9.el9.x86_64.rpm 638 kB/s | 30 kB 00:00 2026-03-09T00:27:58.804 INFO:teuthology.orchestra.run.vm05.stdout:(52/136): flexiblas-netlib-3.0.4-9.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2026-03-09T00:27:58.847 INFO:teuthology.orchestra.run.vm05.stdout:(53/136): flexiblas-openblas-openmp-3.0.4-9.el9 350 kB/s | 15 kB 00:00 2026-03-09T00:27:58.848 INFO:teuthology.orchestra.run.vm05.stdout:(54/136): python3-urllib3-1.26.5-7.el9.noarch.r 262 kB/s | 218 kB 00:00 2026-03-09T00:27:58.900 INFO:teuthology.orchestra.run.vm05.stdout:(55/136): libnbd-1.20.3-4.el9.x86_64.rpm 3.0 MB/s | 164 kB 00:00 2026-03-09T00:27:58.901 INFO:teuthology.orchestra.run.vm05.stdout:(56/136): python3-cffi-1.14.5-5.el9.x86_64.rpm 182 kB/s | 253 kB 00:01 2026-03-09T00:27:58.903 INFO:teuthology.orchestra.run.vm05.stdout:(57/136): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.9 MB/s | 160 kB 00:00 2026-03-09T00:27:58.953 INFO:teuthology.orchestra.run.vm05.stdout:(58/136): libstoragemgmt-1.10.1-1.el9.x86_64.rp 4.8 MB/s | 246 kB 00:00 2026-03-09T00:27:58.954 INFO:teuthology.orchestra.run.vm05.stdout:(59/136): librabbitmq-0.11.0-7.el9.x86_64.rpm 843 kB/s | 45 kB 00:00 2026-03-09T00:27:58.966 INFO:teuthology.orchestra.run.vm05.stdout:(60/136): librdkafka-1.6.1-102.el9.x86_64.rpm 10 MB/s | 662 kB 00:00 2026-03-09T00:27:59.002 INFO:teuthology.orchestra.run.vm05.stdout:(61/136): libxslt-1.1.34-12.el9.x86_64.rpm 4.7 MB/s | 233 kB 00:00 2026-03-09T00:27:59.008 INFO:teuthology.orchestra.run.vm05.stdout:(62/136): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.3 MB/s | 292 kB 00:00 2026-03-09T00:27:59.012 INFO:teuthology.orchestra.run.vm05.stdout:(63/136): lua-5.4.4-4.el9.x86_64.rpm 4.1 MB/s | 188 kB 00:00 2026-03-09T00:27:59.048 INFO:teuthology.orchestra.run.vm05.stdout:(64/136): openblas-0.3.29-1.el9.x86_64.rpm 921 kB/s | 42 kB 00:00 2026-03-09T00:27:59.098 INFO:teuthology.orchestra.run.vm05.stdout:(65/136): protobuf-3.14.0-17.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2026-03-09T00:27:59.175 INFO:teuthology.orchestra.run.vm05.stdout:(66/136): openblas-openmp-0.3.29-1.el9.x86_64.r 32 MB/s | 5.3 MB 00:00 2026-03-09T00:27:59.183 INFO:teuthology.orchestra.run.vm05.stdout:(67/136): python3-devel-3.9.25-3.el9.x86_64.rpm 2.8 MB/s | 244 kB 00:00 2026-03-09T00:27:59.257 INFO:teuthology.orchestra.run.vm05.stdout:(68/136): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2026-03-09T00:27:59.258 INFO:teuthology.orchestra.run.vm05.stdout:(69/136): python3-jmespath-1.0.1-1.el9.noarch.r 640 kB/s | 48 kB 00:00 2026-03-09T00:27:59.259 INFO:teuthology.orchestra.run.vm05.stdout:(70/136): python3-jinja2-2.11.3-8.el9.noarch.rp 2.9 MB/s | 249 kB 00:00 2026-03-09T00:27:59.298 INFO:teuthology.orchestra.run.vm05.stdout:(71/136): python3-markupsafe-1.1.1-12.el9.x86_6 882 kB/s | 35 kB 00:00 2026-03-09T00:27:59.305 INFO:teuthology.orchestra.run.vm05.stdout:(72/136): python3-mako-1.1.4-6.el9.noarch.rpm 3.5 MB/s | 172 kB 00:00 2026-03-09T00:27:59.307 INFO:teuthology.orchestra.run.vm05.stdout:(73/136): python3-libstoragemgmt-1.10.1-1.el9.x 3.4 MB/s | 177 kB 00:00 2026-03-09T00:27:59.360 INFO:teuthology.orchestra.run.vm05.stdout:(74/136): python3-packaging-20.9-5.el9.noarch.r 1.4 MB/s | 77 kB 00:00 2026-03-09T00:27:59.365 INFO:teuthology.orchestra.run.vm05.stdout:(75/136): python3-numpy-f2py-1.23.5-2.el9.x86_6 7.3 MB/s | 442 kB 00:00 2026-03-09T00:27:59.444 INFO:teuthology.orchestra.run.vm05.stdout:(76/136): python3-numpy-1.23.5-2.el9.x86_64.rpm 42 MB/s | 6.1 MB 00:00 2026-03-09T00:27:59.445 INFO:teuthology.orchestra.run.vm05.stdout:(77/136): python3-protobuf-3.14.0-17.el9.noarch 3.1 MB/s | 267 kB 00:00 2026-03-09T00:27:59.445 INFO:teuthology.orchestra.run.vm05.stdout:(78/136): python3-pyasn1-0.4.8-7.el9.noarch.rpm 1.9 MB/s | 157 kB 00:00 2026-03-09T00:27:59.491 INFO:teuthology.orchestra.run.vm05.stdout:(79/136): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 54 kB 00:00 2026-03-09T00:27:59.506 INFO:teuthology.orchestra.run.vm05.stdout:(80/136): python3-pyasn1-modules-0.4.8-7.el9.no 4.5 MB/s | 277 kB 00:00 2026-03-09T00:27:59.542 INFO:teuthology.orchestra.run.vm05.stdout:(81/136): python3-toml-0.10.2-6.el9.noarch.rpm 833 kB/s | 42 kB 00:00 2026-03-09T00:27:59.563 INFO:teuthology.orchestra.run.vm05.stdout:(82/136): qatlib-25.08.0-2.el9.x86_64.rpm 4.1 MB/s | 240 kB 00:00 2026-03-09T00:27:59.600 INFO:teuthology.orchestra.run.vm05.stdout:(83/136): qatlib-service-25.08.0-2.el9.x86_64.r 639 kB/s | 37 kB 00:00 2026-03-09T00:27:59.644 INFO:teuthology.orchestra.run.vm05.stdout:(84/136): qatzip-libs-1.3.1-1.el9.x86_64.rpm 824 kB/s | 66 kB 00:00 2026-03-09T00:27:59.682 INFO:teuthology.orchestra.run.vm05.stdout:(85/136): socat-1.7.4.1-8.el9.x86_64.rpm 3.6 MB/s | 303 kB 00:00 2026-03-09T00:27:59.698 INFO:teuthology.orchestra.run.vm05.stdout:(86/136): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2026-03-09T00:27:59.765 INFO:teuthology.orchestra.run.vm05.stdout:(87/136): python3-scipy-1.9.3-2.el9.x86_64.rpm 60 MB/s | 19 MB 00:00 2026-03-09T00:27:59.781 INFO:teuthology.orchestra.run.vm05.stdout:(88/136): abseil-cpp-20211102.0-4.el9.x86_64.rp 35 MB/s | 551 kB 00:00 2026-03-09T00:27:59.787 INFO:teuthology.orchestra.run.vm05.stdout:(89/136): gperftools-libs-2.9.1-3.el9.x86_64.rp 44 MB/s | 308 kB 00:00 2026-03-09T00:27:59.790 INFO:teuthology.orchestra.run.vm05.stdout:(90/136): grpc-data-1.46.7-10.el9.noarch.rpm 7.5 MB/s | 19 kB 00:00 2026-03-09T00:27:59.847 INFO:teuthology.orchestra.run.vm05.stdout:(91/136): libarrow-9.0.0-15.el9.x86_64.rpm 77 MB/s | 4.4 MB 00:00 2026-03-09T00:27:59.850 INFO:teuthology.orchestra.run.vm05.stdout:(92/136): libarrow-doc-9.0.0-15.el9.noarch.rpm 8.3 MB/s | 25 kB 00:00 2026-03-09T00:27:59.853 INFO:teuthology.orchestra.run.vm05.stdout:(93/136): liboath-2.6.12-1.el9.x86_64.rpm 19 MB/s | 49 kB 00:00 2026-03-09T00:27:59.856 INFO:teuthology.orchestra.run.vm05.stdout:(94/136): libunwind-1.6.2-1.el9.x86_64.rpm 26 MB/s | 67 kB 00:00 2026-03-09T00:27:59.860 INFO:teuthology.orchestra.run.vm05.stdout:(95/136): luarocks-3.9.2-5.el9.noarch.rpm 40 MB/s | 151 kB 00:00 2026-03-09T00:27:59.871 INFO:teuthology.orchestra.run.vm05.stdout:(96/136): parquet-libs-9.0.0-15.el9.x86_64.rpm 73 MB/s | 838 kB 00:00 2026-03-09T00:27:59.879 INFO:teuthology.orchestra.run.vm05.stdout:(97/136): python3-asyncssh-2.13.2-5.el9.noarch. 70 MB/s | 548 kB 00:00 2026-03-09T00:27:59.882 INFO:teuthology.orchestra.run.vm05.stdout:(98/136): python3-autocommand-2.2.2-8.el9.noarc 10 MB/s | 29 kB 00:00 2026-03-09T00:27:59.884 INFO:teuthology.orchestra.run.vm05.stdout:(99/136): python3-backports-tarfile-1.2.0-1.el9 24 MB/s | 60 kB 00:00 2026-03-09T00:27:59.887 INFO:teuthology.orchestra.run.vm05.stdout:(100/136): python3-bcrypt-3.2.2-1.el9.x86_64.rp 19 MB/s | 43 kB 00:00 2026-03-09T00:27:59.890 INFO:teuthology.orchestra.run.vm05.stdout:(101/136): python3-cachetools-4.2.4-1.el9.noarc 13 MB/s | 32 kB 00:00 2026-03-09T00:27:59.892 INFO:teuthology.orchestra.run.vm05.stdout:(102/136): python3-certifi-2023.05.07-4.el9.noa 6.1 MB/s | 14 kB 00:00 2026-03-09T00:27:59.896 INFO:teuthology.orchestra.run.vm05.stdout:(103/136): python3-cheroot-10.0.1-4.el9.noarch. 45 MB/s | 173 kB 00:00 2026-03-09T00:27:59.902 INFO:teuthology.orchestra.run.vm05.stdout:(104/136): python3-cherrypy-18.6.1-2.el9.noarch 60 MB/s | 358 kB 00:00 2026-03-09T00:27:59.907 INFO:teuthology.orchestra.run.vm05.stdout:(105/136): python3-google-auth-2.45.0-1.el9.noa 48 MB/s | 254 kB 00:00 2026-03-09T00:27:59.934 INFO:teuthology.orchestra.run.vm05.stdout:(106/136): python3-grpcio-1.46.7-10.el9.x86_64. 77 MB/s | 2.0 MB 00:00 2026-03-09T00:27:59.937 INFO:teuthology.orchestra.run.vm05.stdout:(107/136): python3-grpcio-tools-1.46.7-10.el9.x 39 MB/s | 144 kB 00:00 2026-03-09T00:27:59.939 INFO:teuthology.orchestra.run.vm05.stdout:(108/136): python3-jaraco-8.2.1-3.el9.noarch.rp 4.7 MB/s | 11 kB 00:00 2026-03-09T00:27:59.942 INFO:teuthology.orchestra.run.vm05.stdout:(109/136): python3-jaraco-classes-3.2.1-5.el9.n 7.3 MB/s | 18 kB 00:00 2026-03-09T00:27:59.945 INFO:teuthology.orchestra.run.vm05.stdout:(110/136): python3-jaraco-collections-3.0.0-8.e 9.1 MB/s | 23 kB 00:00 2026-03-09T00:27:59.947 INFO:teuthology.orchestra.run.vm05.stdout:(111/136): python3-jaraco-context-6.0.1-3.el9.n 8.9 MB/s | 20 kB 00:00 2026-03-09T00:27:59.949 INFO:teuthology.orchestra.run.vm05.stdout:(112/136): python3-jaraco-functools-3.5.0-2.el9 9.3 MB/s | 19 kB 00:00 2026-03-09T00:27:59.952 INFO:teuthology.orchestra.run.vm05.stdout:(113/136): python3-jaraco-text-4.0.0-2.el9.noar 9.5 MB/s | 26 kB 00:00 2026-03-09T00:27:59.965 INFO:teuthology.orchestra.run.vm05.stdout:(114/136): python3-kubernetes-26.1.0-3.el9.noar 77 MB/s | 1.0 MB 00:00 2026-03-09T00:27:59.968 INFO:teuthology.orchestra.run.vm05.stdout:(115/136): python3-logutils-0.3.5-21.el9.noarch 17 MB/s | 46 kB 00:00 2026-03-09T00:27:59.971 INFO:teuthology.orchestra.run.vm05.stdout:(116/136): python3-more-itertools-8.12.0-2.el9. 29 MB/s | 79 kB 00:00 2026-03-09T00:27:59.974 INFO:teuthology.orchestra.run.vm05.stdout:(117/136): python3-natsort-7.1.1-5.el9.noarch.r 21 MB/s | 58 kB 00:00 2026-03-09T00:27:59.979 INFO:teuthology.orchestra.run.vm05.stdout:(118/136): python3-pecan-1.4.2-3.el9.noarch.rpm 55 MB/s | 272 kB 00:00 2026-03-09T00:27:59.984 INFO:teuthology.orchestra.run.vm05.stdout:(119/136): python3-portend-3.1.0-2.el9.noarch.r 3.7 MB/s | 16 kB 00:00 2026-03-09T00:27:59.988 INFO:teuthology.orchestra.run.vm05.stdout:(120/136): python3-pyOpenSSL-21.0.0-1.el9.noarc 23 MB/s | 90 kB 00:00 2026-03-09T00:27:59.991 INFO:teuthology.orchestra.run.vm05.stdout:(121/136): python3-repoze-lru-0.7-16.el9.noarch 10 MB/s | 31 kB 00:00 2026-03-09T00:27:59.996 INFO:teuthology.orchestra.run.vm05.stdout:(122/136): python3-routes-2.5.1-5.el9.noarch.rp 41 MB/s | 188 kB 00:00 2026-03-09T00:27:59.999 INFO:teuthology.orchestra.run.vm05.stdout:(123/136): python3-rsa-4.9-2.el9.noarch.rpm 21 MB/s | 59 kB 00:00 2026-03-09T00:28:00.002 INFO:teuthology.orchestra.run.vm05.stdout:(124/136): python3-tempora-5.0.0-2.el9.noarch.r 12 MB/s | 36 kB 00:00 2026-03-09T00:28:00.006 INFO:teuthology.orchestra.run.vm05.stdout:(125/136): python3-typing-extensions-4.15.0-1.e 29 MB/s | 86 kB 00:00 2026-03-09T00:28:00.011 INFO:teuthology.orchestra.run.vm05.stdout:(126/136): python3-webob-1.8.8-2.el9.noarch.rpm 46 MB/s | 230 kB 00:00 2026-03-09T00:28:00.014 INFO:teuthology.orchestra.run.vm05.stdout:(127/136): python3-websocket-client-1.2.3-2.el9 28 MB/s | 90 kB 00:00 2026-03-09T00:28:00.023 INFO:teuthology.orchestra.run.vm05.stdout:(128/136): python3-werkzeug-2.0.3-3.el9.1.noarc 50 MB/s | 427 kB 00:00 2026-03-09T00:28:00.025 INFO:teuthology.orchestra.run.vm05.stdout:(129/136): python3-xmltodict-0.12.0-15.el9.noar 9.9 MB/s | 22 kB 00:00 2026-03-09T00:28:00.028 INFO:teuthology.orchestra.run.vm05.stdout:(130/136): python3-zc-lockfile-2.0-10.el9.noarc 7.6 MB/s | 20 kB 00:00 2026-03-09T00:28:00.033 INFO:teuthology.orchestra.run.vm05.stdout:(131/136): re2-20211101-20.el9.x86_64.rpm 39 MB/s | 191 kB 00:00 2026-03-09T00:28:00.054 INFO:teuthology.orchestra.run.vm05.stdout:(132/136): thrift-0.15.0-4.el9.x86_64.rpm 78 MB/s | 1.6 MB 00:00 2026-03-09T00:28:00.058 INFO:teuthology.orchestra.run.vm05.stdout:(133/136): lua-devel-5.4.4-4.el9.x86_64.rpm 59 kB/s | 22 kB 00:00 2026-03-09T00:28:00.267 INFO:teuthology.orchestra.run.vm05.stdout:(134/136): protobuf-compiler-3.14.0-17.el9.x86_ 1.5 MB/s | 862 kB 00:00 2026-03-09T00:28:01.044 INFO:teuthology.orchestra.run.vm05.stdout:(135/136): librbd1-19.2.3-678.ge911bdeb.el9.x86 3.2 MB/s | 3.2 MB 00:00 2026-03-09T00:28:01.123 INFO:teuthology.orchestra.run.vm05.stdout:(136/136): librados2-19.2.3-678.ge911bdeb.el9.x 3.2 MB/s | 3.4 MB 00:01 2026-03-09T00:28:01.126 INFO:teuthology.orchestra.run.vm05.stdout:-------------------------------------------------------------------------------- 2026-03-09T00:28:01.126 INFO:teuthology.orchestra.run.vm05.stdout:Total 20 MB/s | 210 MB 00:10 2026-03-09T00:28:01.841 INFO:teuthology.orchestra.run.vm05.stdout:Running transaction check 2026-03-09T00:28:01.895 INFO:teuthology.orchestra.run.vm05.stdout:Transaction check succeeded. 2026-03-09T00:28:01.895 INFO:teuthology.orchestra.run.vm05.stdout:Running transaction test 2026-03-09T00:28:02.761 INFO:teuthology.orchestra.run.vm05.stdout:Transaction test succeeded. 2026-03-09T00:28:02.761 INFO:teuthology.orchestra.run.vm05.stdout:Running transaction 2026-03-09T00:28:03.719 INFO:teuthology.orchestra.run.vm05.stdout: Preparing : 1/1 2026-03-09T00:28:03.735 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/138 2026-03-09T00:28:03.750 INFO:teuthology.orchestra.run.vm05.stdout: Installing : thrift-0.15.0-4.el9.x86_64 2/138 2026-03-09T00:28:03.939 INFO:teuthology.orchestra.run.vm05.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 3/138 2026-03-09T00:28:03.941 INFO:teuthology.orchestra.run.vm05.stdout: Upgrading : librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T00:28:04.007 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T00:28:04.010 INFO:teuthology.orchestra.run.vm05.stdout: Installing : libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 5/138 2026-03-09T00:28:04.046 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 5/138 2026-03-09T00:28:04.057 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 6/138 2026-03-09T00:28:04.062 INFO:teuthology.orchestra.run.vm05.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/138 2026-03-09T00:28:04.065 INFO:teuthology.orchestra.run.vm05.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/138 2026-03-09T00:28:04.071 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/138 2026-03-09T00:28:04.083 INFO:teuthology.orchestra.run.vm05.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 10/138 2026-03-09T00:28:04.085 INFO:teuthology.orchestra.run.vm05.stdout: Installing : libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T00:28:04.126 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T00:28:04.128 INFO:teuthology.orchestra.run.vm05.stdout: Installing : libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 12/138 2026-03-09T00:28:04.146 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 12/138 2026-03-09T00:28:04.185 INFO:teuthology.orchestra.run.vm05.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/138 2026-03-09T00:28:04.227 INFO:teuthology.orchestra.run.vm05.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/138 2026-03-09T00:28:04.233 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 15/138 2026-03-09T00:28:04.261 INFO:teuthology.orchestra.run.vm05.stdout: Installing : liboath-2.6.12-1.el9.x86_64 16/138 2026-03-09T00:28:04.277 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 17/138 2026-03-09T00:28:04.285 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/138 2026-03-09T00:28:04.297 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/138 2026-03-09T00:28:04.304 INFO:teuthology.orchestra.run.vm05.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 20/138 2026-03-09T00:28:04.308 INFO:teuthology.orchestra.run.vm05.stdout: Installing : lua-5.4.4-4.el9.x86_64 21/138 2026-03-09T00:28:04.315 INFO:teuthology.orchestra.run.vm05.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 22/138 2026-03-09T00:28:04.345 INFO:teuthology.orchestra.run.vm05.stdout: Installing : unzip-6.0-59.el9.x86_64 23/138 2026-03-09T00:28:04.364 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 24/138 2026-03-09T00:28:04.368 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 25/138 2026-03-09T00:28:04.376 INFO:teuthology.orchestra.run.vm05.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 26/138 2026-03-09T00:28:04.379 INFO:teuthology.orchestra.run.vm05.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 27/138 2026-03-09T00:28:04.411 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 28/138 2026-03-09T00:28:04.418 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x 29/138 2026-03-09T00:28:04.429 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9 30/138 2026-03-09T00:28:04.443 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 31/138 2026-03-09T00:28:04.453 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 32/138 2026-03-09T00:28:04.483 INFO:teuthology.orchestra.run.vm05.stdout: Installing : zip-3.0-35.el9.x86_64 33/138 2026-03-09T00:28:04.489 INFO:teuthology.orchestra.run.vm05.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/138 2026-03-09T00:28:04.499 INFO:teuthology.orchestra.run.vm05.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/138 2026-03-09T00:28:04.530 INFO:teuthology.orchestra.run.vm05.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 36/138 2026-03-09T00:28:04.594 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/138 2026-03-09T00:28:04.611 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 38/138 2026-03-09T00:28:04.619 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/138 2026-03-09T00:28:04.629 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/138 2026-03-09T00:28:04.637 INFO:teuthology.orchestra.run.vm05.stdout: Installing : librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 41/138 2026-03-09T00:28:04.642 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 42/138 2026-03-09T00:28:04.661 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 43/138 2026-03-09T00:28:04.689 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 44/138 2026-03-09T00:28:04.696 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 45/138 2026-03-09T00:28:04.703 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 46/138 2026-03-09T00:28:04.718 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 47/138 2026-03-09T00:28:04.731 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 48/138 2026-03-09T00:28:04.743 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 49/138 2026-03-09T00:28:04.811 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 50/138 2026-03-09T00:28:04.820 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 51/138 2026-03-09T00:28:04.831 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 52/138 2026-03-09T00:28:04.892 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 53/138 2026-03-09T00:28:05.287 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 54/138 2026-03-09T00:28:05.303 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 55/138 2026-03-09T00:28:05.310 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 56/138 2026-03-09T00:28:05.317 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 57/138 2026-03-09T00:28:05.322 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 58/138 2026-03-09T00:28:05.330 INFO:teuthology.orchestra.run.vm05.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/138 2026-03-09T00:28:05.334 INFO:teuthology.orchestra.run.vm05.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 60/138 2026-03-09T00:28:05.336 INFO:teuthology.orchestra.run.vm05.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 61/138 2026-03-09T00:28:05.366 INFO:teuthology.orchestra.run.vm05.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 62/138 2026-03-09T00:28:05.418 INFO:teuthology.orchestra.run.vm05.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 63/138 2026-03-09T00:28:05.431 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 64/138 2026-03-09T00:28:05.439 INFO:teuthology.orchestra.run.vm05.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 65/138 2026-03-09T00:28:05.444 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/138 2026-03-09T00:28:05.452 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/138 2026-03-09T00:28:05.457 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 68/138 2026-03-09T00:28:05.467 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/138 2026-03-09T00:28:05.471 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/138 2026-03-09T00:28:05.505 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/138 2026-03-09T00:28:05.519 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 72/138 2026-03-09T00:28:05.565 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/138 2026-03-09T00:28:05.844 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 74/138 2026-03-09T00:28:05.875 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 75/138 2026-03-09T00:28:05.881 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 76/138 2026-03-09T00:28:05.943 INFO:teuthology.orchestra.run.vm05.stdout: Installing : openblas-0.3.29-1.el9.x86_64 77/138 2026-03-09T00:28:05.946 INFO:teuthology.orchestra.run.vm05.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 78/138 2026-03-09T00:28:05.970 INFO:teuthology.orchestra.run.vm05.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 79/138 2026-03-09T00:28:06.361 INFO:teuthology.orchestra.run.vm05.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 80/138 2026-03-09T00:28:06.457 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 81/138 2026-03-09T00:28:07.277 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 82/138 2026-03-09T00:28:07.305 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 83/138 2026-03-09T00:28:07.312 INFO:teuthology.orchestra.run.vm05.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 84/138 2026-03-09T00:28:07.317 INFO:teuthology.orchestra.run.vm05.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 85/138 2026-03-09T00:28:07.478 INFO:teuthology.orchestra.run.vm05.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 86/138 2026-03-09T00:28:07.481 INFO:teuthology.orchestra.run.vm05.stdout: Upgrading : librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 87/138 2026-03-09T00:28:07.515 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 87/138 2026-03-09T00:28:07.519 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 88/138 2026-03-09T00:28:07.528 INFO:teuthology.orchestra.run.vm05.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 89/138 2026-03-09T00:28:07.790 INFO:teuthology.orchestra.run.vm05.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 90/138 2026-03-09T00:28:07.793 INFO:teuthology.orchestra.run.vm05.stdout: Installing : librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 91/138 2026-03-09T00:28:07.813 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 91/138 2026-03-09T00:28:07.815 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 92/138 2026-03-09T00:28:08.951 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T00:28:08.956 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T00:28:08.980 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 93/138 2026-03-09T00:28:08.999 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-ply-3.11-14.el9.noarch 94/138 2026-03-09T00:28:09.019 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 95/138 2026-03-09T00:28:09.111 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 96/138 2026-03-09T00:28:09.125 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 97/138 2026-03-09T00:28:09.156 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 98/138 2026-03-09T00:28:09.194 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 99/138 2026-03-09T00:28:09.277 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 100/138 2026-03-09T00:28:09.287 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 101/138 2026-03-09T00:28:09.293 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 102/138 2026-03-09T00:28:09.300 INFO:teuthology.orchestra.run.vm05.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 103/138 2026-03-09T00:28:09.305 INFO:teuthology.orchestra.run.vm05.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 104/138 2026-03-09T00:28:09.307 INFO:teuthology.orchestra.run.vm05.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 105/138 2026-03-09T00:28:09.329 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 105/138 2026-03-09T00:28:09.659 INFO:teuthology.orchestra.run.vm05.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 106/138 2026-03-09T00:28:09.664 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 107/138 2026-03-09T00:28:09.707 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 107/138 2026-03-09T00:28:09.707 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-03-09T00:28:09.707 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-03-09T00:28:09.707 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:28:09.712 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 108/138 2026-03-09T00:28:17.170 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 108/138 2026-03-09T00:28:17.171 INFO:teuthology.orchestra.run.vm05.stdout:skipping the directory /sys 2026-03-09T00:28:17.171 INFO:teuthology.orchestra.run.vm05.stdout:skipping the directory /proc 2026-03-09T00:28:17.171 INFO:teuthology.orchestra.run.vm05.stdout:skipping the directory /mnt 2026-03-09T00:28:17.171 INFO:teuthology.orchestra.run.vm05.stdout:skipping the directory /var/tmp 2026-03-09T00:28:17.171 INFO:teuthology.orchestra.run.vm05.stdout:skipping the directory /home 2026-03-09T00:28:17.171 INFO:teuthology.orchestra.run.vm05.stdout:skipping the directory /root 2026-03-09T00:28:17.171 INFO:teuthology.orchestra.run.vm05.stdout:skipping the directory /tmp 2026-03-09T00:28:17.171 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:28:17.310 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 109/138 2026-03-09T00:28:17.339 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 109/138 2026-03-09T00:28:17.339 INFO:teuthology.orchestra.run.vm05.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:28:17.339 INFO:teuthology.orchestra.run.vm05.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-03-09T00:28:17.339 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-03-09T00:28:17.339 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-03-09T00:28:17.339 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:28:17.600 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 110/138 2026-03-09T00:28:17.626 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 110/138 2026-03-09T00:28:17.626 INFO:teuthology.orchestra.run.vm05.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:28:17.626 INFO:teuthology.orchestra.run.vm05.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-03-09T00:28:17.626 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-03-09T00:28:17.626 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-03-09T00:28:17.626 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:28:17.635 INFO:teuthology.orchestra.run.vm05.stdout: Installing : mailcap-2.1.49-5.el9.noarch 111/138 2026-03-09T00:28:17.638 INFO:teuthology.orchestra.run.vm05.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 112/138 2026-03-09T00:28:17.658 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T00:28:17.658 INFO:teuthology.orchestra.run.vm05.stdout:Creating group 'qat' with GID 994. 2026-03-09T00:28:17.658 INFO:teuthology.orchestra.run.vm05.stdout:Creating group 'libstoragemgmt' with GID 993. 2026-03-09T00:28:17.658 INFO:teuthology.orchestra.run.vm05.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 993 and GID 993. 2026-03-09T00:28:17.658 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:28:17.669 INFO:teuthology.orchestra.run.vm05.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T00:28:17.698 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 113/138 2026-03-09T00:28:17.698 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-03-09T00:28:17.698 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:28:17.742 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 114/138 2026-03-09T00:28:17.824 INFO:teuthology.orchestra.run.vm05.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 115/138 2026-03-09T00:28:17.829 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 116/138 2026-03-09T00:28:17.845 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 116/138 2026-03-09T00:28:17.845 INFO:teuthology.orchestra.run.vm05.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:28:17.845 INFO:teuthology.orchestra.run.vm05.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-03-09T00:28:17.845 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:28:18.757 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 117/138 2026-03-09T00:28:18.788 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 117/138 2026-03-09T00:28:18.788 INFO:teuthology.orchestra.run.vm05.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:28:18.788 INFO:teuthology.orchestra.run.vm05.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-03-09T00:28:18.788 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-03-09T00:28:18.788 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-03-09T00:28:18.788 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:28:18.861 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 118/138 2026-03-09T00:28:18.865 INFO:teuthology.orchestra.run.vm05.stdout: Installing : cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 118/138 2026-03-09T00:28:18.871 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el 119/138 2026-03-09T00:28:18.897 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.e 120/138 2026-03-09T00:28:18.899 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 121/138 2026-03-09T00:28:19.455 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 121/138 2026-03-09T00:28:19.461 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 122/138 2026-03-09T00:28:20.013 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 122/138 2026-03-09T00:28:20.015 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 123/138 2026-03-09T00:28:20.080 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 123/138 2026-03-09T00:28:20.140 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9 124/138 2026-03-09T00:28:20.142 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 125/138 2026-03-09T00:28:20.173 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 125/138 2026-03-09T00:28:20.174 INFO:teuthology.orchestra.run.vm05.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:28:20.174 INFO:teuthology.orchestra.run.vm05.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-03-09T00:28:20.174 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-03-09T00:28:20.174 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-03-09T00:28:20.174 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:28:20.188 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 126/138 2026-03-09T00:28:20.203 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 126/138 2026-03-09T00:28:20.756 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 127/138 2026-03-09T00:28:20.759 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 128/138 2026-03-09T00:28:20.785 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 128/138 2026-03-09T00:28:20.785 INFO:teuthology.orchestra.run.vm05.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:28:20.785 INFO:teuthology.orchestra.run.vm05.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-03-09T00:28:20.785 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-03-09T00:28:20.785 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-03-09T00:28:20.785 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:28:20.797 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-678.ge911bd 129/138 2026-03-09T00:28:20.821 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-678.ge911bd 129/138 2026-03-09T00:28:20.821 INFO:teuthology.orchestra.run.vm05.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:28:20.821 INFO:teuthology.orchestra.run.vm05.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-03-09T00:28:20.821 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:28:20.982 INFO:teuthology.orchestra.run.vm05.stdout: Installing : rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 130/138 2026-03-09T00:28:21.006 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 130/138 2026-03-09T00:28:21.007 INFO:teuthology.orchestra.run.vm05.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-03-09T00:28:21.007 INFO:teuthology.orchestra.run.vm05.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-03-09T00:28:21.007 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-03-09T00:28:21.007 INFO:teuthology.orchestra.run.vm05.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-03-09T00:28:21.007 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:28:23.695 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 131/138 2026-03-09T00:28:23.707 INFO:teuthology.orchestra.run.vm05.stdout: Installing : rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 132/138 2026-03-09T00:28:23.716 INFO:teuthology.orchestra.run.vm05.stdout: Installing : rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 133/138 2026-03-09T00:28:23.776 INFO:teuthology.orchestra.run.vm05.stdout: Installing : libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_6 134/138 2026-03-09T00:28:23.786 INFO:teuthology.orchestra.run.vm05.stdout: Installing : ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 135/138 2026-03-09T00:28:23.790 INFO:teuthology.orchestra.run.vm05.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 136/138 2026-03-09T00:28:23.790 INFO:teuthology.orchestra.run.vm05.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/138 2026-03-09T00:28:23.808 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/138 2026-03-09T00:28:23.808 INFO:teuthology.orchestra.run.vm05.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T00:28:25.504 INFO:teuthology.orchestra.run.vm05.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T00:28:25.504 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 1/138 2026-03-09T00:28:25.504 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 2/138 2026-03-09T00:28:25.505 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 3/138 2026-03-09T00:28:25.510 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 4/138 2026-03-09T00:28:25.510 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-678.ge911bd 5/138 2026-03-09T00:28:25.510 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 6/138 2026-03-09T00:28:25.510 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 7/138 2026-03-09T00:28:25.510 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 8/138 2026-03-09T00:28:25.510 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 9/138 2026-03-09T00:28:25.510 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 10/138 2026-03-09T00:28:25.510 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 11/138 2026-03-09T00:28:25.510 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 12/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_6 13/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 14/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 15/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 16/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_ 17/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 18/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9 19/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x 20/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 21/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 22/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 23/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 24/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 25/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 26/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 27/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.e 28/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noar 29/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.no 30/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-678.ge911 31/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9 32/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 33/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el 34/138 2026-03-09T00:28:25.511 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 35/138 2026-03-09T00:28:25.512 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 36/138 2026-03-09T00:28:25.512 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 37/138 2026-03-09T00:28:25.512 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 38/138 2026-03-09T00:28:25.512 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 39/138 2026-03-09T00:28:25.512 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 40/138 2026-03-09T00:28:25.512 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 41/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 42/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 43/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 44/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 45/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-ply-3.11-14.el9.noarch 46/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 47/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 48/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 49/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : unzip-6.0-59.el9.x86_64 50/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : zip-3.0-35.el9.x86_64 51/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 52/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 53/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 54/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 55/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 56/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 60/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 61/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : lua-5.4.4-4.el9.x86_64 63/138 2026-03-09T00:28:25.513 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 64/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 65/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 66/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 68/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 69/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 70/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 71/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 74/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 75/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 77/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 78/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 79/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/138 2026-03-09T00:28:25.514 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 81/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 83/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 84/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 85/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 86/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 88/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 89/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 90/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 91/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 92/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 93/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 94/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 95/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 96/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 97/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 98/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 99/138 2026-03-09T00:28:25.515 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 100/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 101/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 105/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 107/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 108/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 109/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 113/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 114/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 115/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 116/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 127/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 128/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 131/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 132/138 2026-03-09T00:28:25.516 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : re2-1:20211101-20.el9.x86_64 133/138 2026-03-09T00:28:25.517 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 134/138 2026-03-09T00:28:25.517 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 135/138 2026-03-09T00:28:25.517 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 136/138 2026-03-09T00:28:25.517 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 137/138 2026-03-09T00:28:25.676 INFO:teuthology.orchestra.run.vm05.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 138/138 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout:Upgraded: 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: librados2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: librbd1-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout:Installed: 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-base-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-grafana-dashboards-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-immutable-object-cache-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mds-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mgr-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mgr-cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mgr-dashboard-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mgr-diskprediction-local-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mgr-modules-core-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mgr-rook-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-mon-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-osd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-prometheus-alerts-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-radosgw-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-selinux-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-test-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ceph-volume-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: cephadm-2:19.2.3-678.ge911bdeb.el9.noarch 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: grpc-data-1.46.7-10.el9.noarch 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: libarrow-9.0.0-15.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: libcephfs-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: libcephfs2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: libcephsqlite-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: libconfig-1.7.2-9.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: libnbd-1.20.3-4.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: liboath-2.6.12-1.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: librados-devel-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: libradosstriper1-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: librgw2-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: libunwind-1.6.2-1.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: libxslt-1.1.34-12.el9.x86_64 2026-03-09T00:28:25.677 INFO:teuthology.orchestra.run.vm05.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: lua-5.4.4-4.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: luarocks-3.9.2-5.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: mailcap-2.1.49-5.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: openblas-0.3.29-1.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: pciutils-3.7.0-7.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: protobuf-3.14.0-17.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-babel-2.9.1-2.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-ceph-argparse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-ceph-common-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-cephfs-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-mako-1.1.4-6.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-packaging-20.9-5.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-ply-3.11-14.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-portend-3.1.0-2.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-pycparser-2.20-6.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-rados-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-rbd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-requests-2.25.1-10.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-03-09T00:28:25.678 INFO:teuthology.orchestra.run.vm05.stdout: python3-rgw-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: python3-routes-2.5.1-5.el9.noarch 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: python3-rsa-4.9-2.el9.noarch 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: python3-toml-0.10.2-6.el9.noarch 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: python3-webob-1.8.8-2.el9.noarch 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: qatlib-25.08.0-2.el9.x86_64 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: rbd-fuse-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: rbd-mirror-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: rbd-nbd-2:19.2.3-678.ge911bdeb.el9.x86_64 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: re2-1:20211101-20.el9.x86_64 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: socat-1.7.4.1-8.el9.x86_64 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: thrift-0.15.0-4.el9.x86_64 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: unzip-6.0-59.el9.x86_64 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: zip-3.0-35.el9.x86_64 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:28:25.679 INFO:teuthology.orchestra.run.vm05.stdout:Complete! 2026-03-09T00:28:25.800 DEBUG:teuthology.parallel:result is None 2026-03-09T00:28:25.801 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:28:26.440 DEBUG:teuthology.orchestra.run.vm05:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-03-09T00:28:26.467 INFO:teuthology.orchestra.run.vm05.stdout:19.2.3-678.ge911bdeb.el9 2026-03-09T00:28:26.467 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-678.ge911bdeb.el9 2026-03-09T00:28:26.467 INFO:teuthology.task.install:The correct ceph version 19.2.3-678.ge911bdeb is installed. 2026-03-09T00:28:26.468 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-03-09T00:28:26.468 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:28:26.468 DEBUG:teuthology.orchestra.run.vm05:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-03-09T00:28:26.541 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-03-09T00:28:26.541 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:28:26.541 DEBUG:teuthology.orchestra.run.vm05:> sudo dd of=/usr/bin/daemon-helper 2026-03-09T00:28:26.608 DEBUG:teuthology.orchestra.run.vm05:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-03-09T00:28:26.679 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-03-09T00:28:26.679 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:28:26.679 DEBUG:teuthology.orchestra.run.vm05:> sudo dd of=/usr/bin/adjust-ulimits 2026-03-09T00:28:26.748 DEBUG:teuthology.orchestra.run.vm05:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-03-09T00:28:26.816 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-03-09T00:28:26.816 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:28:26.816 DEBUG:teuthology.orchestra.run.vm05:> sudo dd of=/usr/bin/stdin-killer 2026-03-09T00:28:26.889 DEBUG:teuthology.orchestra.run.vm05:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-03-09T00:28:26.960 INFO:teuthology.run_tasks:Running task cephadm... 2026-03-09T00:28:27.006 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': False}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd mclock iops capacity threshold hdd': 49000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'CEPHADM_FAILED_DAEMON'], 'log-only-match': ['CEPHADM_'], 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df'} 2026-03-09T00:28:27.006 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:28:27.006 INFO:tasks.cephadm:Cluster fsid is e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:28:27.006 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-03-09T00:28:27.006 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '192.168.123.105'} 2026-03-09T00:28:27.006 INFO:tasks.cephadm:First mon is mon.a on vm05 2026-03-09T00:28:27.006 INFO:tasks.cephadm:First mgr is a 2026-03-09T00:28:27.006 INFO:tasks.cephadm:Normalizing hostnames... 2026-03-09T00:28:27.006 DEBUG:teuthology.orchestra.run.vm05:> sudo hostname $(hostname -s) 2026-03-09T00:28:27.038 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-03-09T00:28:27.038 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:28:27.627 INFO:tasks.cephadm:builder_project result: [{'url': 'https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/', 'ref': 'squid', 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-25 18:55:15.146628', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '19.2.3-678-ge911bdeb', 'package_manager_version': '19.2.3-678.ge911bdeb', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3275/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-03-09T00:28:28.236 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 e911bdebe5c8faa3800735d1568fcdca65db60df from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:28:28.238 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/x86_64/flavors/default/cephadm 2026-03-09T00:28:28.238 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/x86_64/flavors/default/cephadm 2026-03-09T00:28:28.238 DEBUG:teuthology.orchestra.run.vm05:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-03-09T00:28:29.616 INFO:teuthology.orchestra.run.vm05.stdout:-rw-r--r--. 1 ubuntu ubuntu 788355 Mar 9 00:28 /home/ubuntu/cephtest/cephadm 2026-03-09T00:28:29.617 DEBUG:teuthology.orchestra.run.vm05:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-03-09T00:28:29.639 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df on all hosts... 2026-03-09T00:28:29.639 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df pull 2026-03-09T00:28:29.848 INFO:teuthology.orchestra.run.vm05.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T00:29:50.423 INFO:teuthology.orchestra.run.vm05.stdout:{ 2026-03-09T00:29:50.423 INFO:teuthology.orchestra.run.vm05.stdout: "ceph_version": "ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable)", 2026-03-09T00:29:50.423 INFO:teuthology.orchestra.run.vm05.stdout: "image_id": "654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c", 2026-03-09T00:29:50.423 INFO:teuthology.orchestra.run.vm05.stdout: "repo_digests": [ 2026-03-09T00:29:50.423 INFO:teuthology.orchestra.run.vm05.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc" 2026-03-09T00:29:50.423 INFO:teuthology.orchestra.run.vm05.stdout: ] 2026-03-09T00:29:50.423 INFO:teuthology.orchestra.run.vm05.stdout:} 2026-03-09T00:29:50.444 DEBUG:teuthology.orchestra.run.vm05:> sudo mkdir -p /etc/ceph 2026-03-09T00:29:50.473 DEBUG:teuthology.orchestra.run.vm05:> sudo chmod 777 /etc/ceph 2026-03-09T00:29:50.539 INFO:tasks.cephadm:Writing seed config... 2026-03-09T00:29:50.540 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2026-03-09T00:29:50.540 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-03-09T00:29:50.540 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-03-09T00:29:50.540 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = False 2026-03-09T00:29:50.540 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-03-09T00:29:50.540 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-03-09T00:29:50.540 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-03-09T00:29:50.540 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-03-09T00:29:50.540 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-03-09T00:29:50.540 INFO:tasks.cephadm: override: [osd] osd mclock iops capacity threshold hdd = 49000 2026-03-09T00:29:50.540 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:29:50.540 DEBUG:teuthology.orchestra.run.vm05:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-03-09T00:29:50.597 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e3e5866c-1b4e-11f1-8647-4d81740f07c0 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd mclock iops capacity threshold hdd = 49000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = False [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2026-03-09T00:29:50.597 DEBUG:teuthology.orchestra.run.vm05:mon.a> sudo journalctl -f -n 0 -u ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@mon.a.service 2026-03-09T00:29:50.640 DEBUG:teuthology.orchestra.run.vm05:mgr.a> sudo journalctl -f -n 0 -u ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@mgr.a.service 2026-03-09T00:29:50.683 INFO:tasks.cephadm:Bootstrapping... 2026-03-09T00:29:50.683 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df -v bootstrap --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 192.168.123.105 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-03-09T00:29:50.827 INFO:teuthology.orchestra.run.vm05.stdout:-------------------------------------------------------------------------------- 2026-03-09T00:29:50.827 INFO:teuthology.orchestra.run.vm05.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df', '-v', 'bootstrap', '--fsid', 'e3e5866c-1b4e-11f1-8647-4d81740f07c0', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '192.168.123.105', '--skip-admin-label'] 2026-03-09T00:29:50.827 INFO:teuthology.orchestra.run.vm05.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-03-09T00:29:50.827 INFO:teuthology.orchestra.run.vm05.stdout:Verifying podman|docker is present... 2026-03-09T00:29:50.846 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stdout 5.8.0 2026-03-09T00:29:50.846 INFO:teuthology.orchestra.run.vm05.stdout:Verifying lvm2 is present... 2026-03-09T00:29:50.846 INFO:teuthology.orchestra.run.vm05.stdout:Verifying time synchronization is in place... 2026-03-09T00:29:50.853 INFO:teuthology.orchestra.run.vm05.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-03-09T00:29:50.853 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-03-09T00:29:50.859 INFO:teuthology.orchestra.run.vm05.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-03-09T00:29:50.859 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stdout inactive 2026-03-09T00:29:50.864 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stdout enabled 2026-03-09T00:29:50.870 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stdout active 2026-03-09T00:29:50.870 INFO:teuthology.orchestra.run.vm05.stdout:Unit chronyd.service is enabled and running 2026-03-09T00:29:50.870 INFO:teuthology.orchestra.run.vm05.stdout:Repeating the final host check... 2026-03-09T00:29:50.890 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stdout 5.8.0 2026-03-09T00:29:50.890 INFO:teuthology.orchestra.run.vm05.stdout:podman (/bin/podman) version 5.8.0 is present 2026-03-09T00:29:50.890 INFO:teuthology.orchestra.run.vm05.stdout:systemctl is present 2026-03-09T00:29:50.890 INFO:teuthology.orchestra.run.vm05.stdout:lvcreate is present 2026-03-09T00:29:50.897 INFO:teuthology.orchestra.run.vm05.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-03-09T00:29:50.897 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-03-09T00:29:50.903 INFO:teuthology.orchestra.run.vm05.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-03-09T00:29:50.903 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stdout inactive 2026-03-09T00:29:50.911 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stdout enabled 2026-03-09T00:29:50.917 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stdout active 2026-03-09T00:29:50.918 INFO:teuthology.orchestra.run.vm05.stdout:Unit chronyd.service is enabled and running 2026-03-09T00:29:50.918 INFO:teuthology.orchestra.run.vm05.stdout:Host looks OK 2026-03-09T00:29:50.918 INFO:teuthology.orchestra.run.vm05.stdout:Cluster fsid: e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:29:50.918 INFO:teuthology.orchestra.run.vm05.stdout:Acquiring lock 140334682984608 on /run/cephadm/e3e5866c-1b4e-11f1-8647-4d81740f07c0.lock 2026-03-09T00:29:50.918 INFO:teuthology.orchestra.run.vm05.stdout:Lock 140334682984608 acquired on /run/cephadm/e3e5866c-1b4e-11f1-8647-4d81740f07c0.lock 2026-03-09T00:29:50.918 INFO:teuthology.orchestra.run.vm05.stdout:Verifying IP 192.168.123.105 port 3300 ... 2026-03-09T00:29:50.918 INFO:teuthology.orchestra.run.vm05.stdout:Verifying IP 192.168.123.105 port 6789 ... 2026-03-09T00:29:50.918 INFO:teuthology.orchestra.run.vm05.stdout:Base mon IP(s) is [192.168.123.105:3300, 192.168.123.105:6789], mon addrv is [v2:192.168.123.105:3300,v1:192.168.123.105:6789] 2026-03-09T00:29:50.922 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout default via 192.168.123.1 dev eth0 proto dhcp src 192.168.123.105 metric 100 2026-03-09T00:29:50.922 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout 192.168.123.0/24 dev eth0 proto kernel scope link src 192.168.123.105 metric 100 2026-03-09T00:29:50.924 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-03-09T00:29:50.924 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout fe80::/64 dev eth0 proto kernel metric 1024 pref medium 2026-03-09T00:29:50.927 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-03-09T00:29:50.927 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-03-09T00:29:50.927 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-03-09T00:29:50.927 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout 2: eth0: mtu 1500 state UP qlen 1000 2026-03-09T00:29:50.927 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout inet6 fe80::5055:ff:fe00:5/64 scope link noprefixroute 2026-03-09T00:29:50.927 INFO:teuthology.orchestra.run.vm05.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-03-09T00:29:50.927 INFO:teuthology.orchestra.run.vm05.stdout:Mon IP `192.168.123.105` is in CIDR network `192.168.123.0/24` 2026-03-09T00:29:50.927 INFO:teuthology.orchestra.run.vm05.stdout:Mon IP `192.168.123.105` is in CIDR network `192.168.123.0/24` 2026-03-09T00:29:50.927 INFO:teuthology.orchestra.run.vm05.stdout:Inferred mon public CIDR from local network configuration ['192.168.123.0/24', '192.168.123.0/24'] 2026-03-09T00:29:50.927 INFO:teuthology.orchestra.run.vm05.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-03-09T00:29:50.928 INFO:teuthology.orchestra.run.vm05.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T00:29:52.183 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stdout 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c 2026-03-09T00:29:52.184 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T00:29:52.184 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stderr Getting image source signatures 2026-03-09T00:29:52.184 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stderr Copying blob sha256:1752b8d01aa0dd33bbe0ab24e8316174c94fbdcd5d26252e2680bba0624747a7 2026-03-09T00:29:52.184 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stderr Copying blob sha256:8e380faede39ebd4286247457b408d979ab568aafd8389c42ec304b8cfba4e92 2026-03-09T00:29:52.184 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stderr Copying config sha256:654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c 2026-03-09T00:29:52.184 INFO:teuthology.orchestra.run.vm05.stdout:/bin/podman: stderr Writing manifest to image destination 2026-03-09T00:29:52.474 INFO:teuthology.orchestra.run.vm05.stdout:ceph: stdout ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable) 2026-03-09T00:29:52.474 INFO:teuthology.orchestra.run.vm05.stdout:Ceph version: ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable) 2026-03-09T00:29:52.474 INFO:teuthology.orchestra.run.vm05.stdout:Extracting ceph user uid/gid from container image... 2026-03-09T00:29:52.738 INFO:teuthology.orchestra.run.vm05.stdout:stat: stdout 167 167 2026-03-09T00:29:52.739 INFO:teuthology.orchestra.run.vm05.stdout:Creating initial keys... 2026-03-09T00:29:53.053 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph-authtool: stdout AQCAFK5p82AdNxAADv+Lv9ahIdEpeqkqOtTh8g== 2026-03-09T00:29:53.289 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph-authtool: stdout AQCBFK5pIojgCRAAoikd/H4ekpmPDeGAw8BVEQ== 2026-03-09T00:29:53.520 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph-authtool: stdout AQCBFK5p7dauFxAAqwPxZ0FEeJKJMfc8/ARcTg== 2026-03-09T00:29:53.520 INFO:teuthology.orchestra.run.vm05.stdout:Creating initial monmap... 2026-03-09T00:29:53.775 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-03-09T00:29:53.776 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-03-09T00:29:53.776 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:29:53.776 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-03-09T00:29:53.776 INFO:teuthology.orchestra.run.vm05.stdout:monmaptool for a [v2:192.168.123.105:3300,v1:192.168.123.105:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-03-09T00:29:53.776 INFO:teuthology.orchestra.run.vm05.stdout:setting min_mon_release = quincy 2026-03-09T00:29:53.776 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/monmaptool: set fsid to e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:29:53.776 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-03-09T00:29:53.776 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:29:53.776 INFO:teuthology.orchestra.run.vm05.stdout:Creating mon... 2026-03-09T00:29:54.063 INFO:teuthology.orchestra.run.vm05.stdout:create mon.a on 2026-03-09T00:29:54.223 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-03-09T00:29:54.354 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-03-09T00:29:54.484 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0.target → /etc/systemd/system/ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0.target. 2026-03-09T00:29:54.484 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0.target → /etc/systemd/system/ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0.target. 2026-03-09T00:29:54.658 INFO:teuthology.orchestra.run.vm05.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@mon.a 2026-03-09T00:29:54.658 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@mon.a.service: Unit ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@mon.a.service not loaded. 2026-03-09T00:29:54.810 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0.target.wants/ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@mon.a.service → /etc/systemd/system/ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@.service. 2026-03-09T00:29:55.011 INFO:teuthology.orchestra.run.vm05.stdout:firewalld does not appear to be present 2026-03-09T00:29:55.011 INFO:teuthology.orchestra.run.vm05.stdout:Not possible to enable service . firewalld.service is not available 2026-03-09T00:29:55.011 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for mon to start... 2026-03-09T00:29:55.011 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for mon... 2026-03-09T00:29:55.365 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout cluster: 2026-03-09T00:29:55.365 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout id: e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:29:55.365 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-03-09T00:29:55.365 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:55.365 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout services: 2026-03-09T00:29:55.365 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.18099s) 2026-03-09T00:29:55.365 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-03-09T00:29:55.365 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-03-09T00:29:55.366 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:55.366 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout data: 2026-03-09T00:29:55.366 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-03-09T00:29:55.366 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-03-09T00:29:55.366 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-03-09T00:29:55.366 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout pgs: 2026-03-09T00:29:55.366 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:55.366 INFO:teuthology.orchestra.run.vm05.stdout:mon is available 2026-03-09T00:29:55.366 INFO:teuthology.orchestra.run.vm05.stdout:Assimilating anything we can from ceph.conf... 2026-03-09T00:29:55.705 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:55.705 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout [global] 2026-03-09T00:29:55.705 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout fsid = e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:29:55.705 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-03-09T00:29:55.705 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_host = [v2:192.168.123.105:3300,v1:192.168.123.105:6789] 2026-03-09T00:29:55.705 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-03-09T00:29:55.705 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-03-09T00:29:55.705 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-03-09T00:29:55.706 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-03-09T00:29:55.706 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:55.706 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout [mgr] 2026-03-09T00:29:55.706 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = False 2026-03-09T00:29:55.706 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-03-09T00:29:55.706 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:55.706 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout [osd] 2026-03-09T00:29:55.706 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-03-09T00:29:55.706 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-03-09T00:29:55.706 INFO:teuthology.orchestra.run.vm05.stdout:Generating new minimal ceph.conf... 2026-03-09T00:29:56.038 INFO:teuthology.orchestra.run.vm05.stdout:Restarting the monitor... 2026-03-09T00:29:56.522 INFO:teuthology.orchestra.run.vm05.stdout:Setting public_network to 192.168.123.0/24 in mon config section 2026-03-09T00:29:56.546 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.bloom_locality: 0 2026-03-09T00:29:56.845 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.max_successive_merges: 0 2026-03-09T00:29:56.845 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.optimize_filters_for_hits: 0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.paranoid_file_checks: 0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.force_consistency_checks: 1 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.report_bg_io_stats: 0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.ttl: 2592000 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.periodic_compaction_seconds: 0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.enable_blob_files: false 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.min_blob_size: 0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.blob_file_size: 268435456 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.blob_compression_type: NoCompression 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.enable_blob_garbage_collection: false 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.blob_file_starting_level: 0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6c146dfd-62e8-409f-89c4-834f93cca3ca 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773016196547342, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773016196548844, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 84999, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 246, "table_properties": {"data_size": 83151, "index_size": 237, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10161, "raw_average_key_size": 47, "raw_value_size": 77320, "raw_average_value_size": 363, "num_data_blocks": 11, "num_entries": 213, "num_filter_entries": 213, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1773016196, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6c146dfd-62e8-409f-89c4-834f93cca3ca", "db_session_id": "3R86QDQD4X04YBOI2DOO", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773016196548910, "job": 1, "event": "recovery_finished"} 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b1e68f6e00 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: DB pointer 0x55b1e6a00000 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: starting mon.a rank 0 at public addrs [v2:192.168.123.105:3300/0,v1:192.168.123.105:6789/0] at bind addrs [v2:192.168.123.105:3300/0,v1:192.168.123.105:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: ** DB Stats ** 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: ** Compaction Stats [default] ** 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: L0 2/0 84.86 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 66.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: Sum 2/0 84.86 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 66.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 66.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: ** Compaction Stats [default] ** 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 66.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-03-09T00:29:56.846 INFO:journalctl@ceph.mon.a.vm05.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: AddFile(Keys): cumulative 0, interval 0 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: Cumulative compaction: 0.00 GB write, 8.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: Interval compaction: 0.00 GB write, 8.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: Block cache BinnedLRUCache@0x55b1e68f5350#6 capacity: 512.00 MB usage: 26.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: Block cache entry stats(count,size,portion): DataBlock(3,25.11 KB,0.00478923%) FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: ** File Read Latency Histogram By Level [default] ** 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: mon.a@-1(???) e1 preinit fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: mon.a@-1(???).mds e1 new map 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: mon.a@-1(???).mds e1 print_map 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: e1 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: btime 2026-03-09T00:29:55:050276+0000 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: legacy client fscid: -1 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout: No filesystems configured 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: monmap epoch 1 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: last_changed 2026-03-09T00:29:53.638126+0000 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: created 2026-03-09T00:29:53.638126+0000 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: min_mon_release 19 (squid) 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: election_strategy: 1 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: 0: [v2:192.168.123.105:3300/0,v1:192.168.123.105:6789/0] mon.a 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: fsmap 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: osdmap e1: 0 total, 0 up, 0 in 2026-03-09T00:29:56.847 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:56 vm05 ceph-mon[52364]: mgrmap e1: no daemons active 2026-03-09T00:29:56.848 INFO:teuthology.orchestra.run.vm05.stdout:Wrote config to /etc/ceph/ceph.conf 2026-03-09T00:29:56.849 INFO:teuthology.orchestra.run.vm05.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-03-09T00:29:56.849 INFO:teuthology.orchestra.run.vm05.stdout:Creating mgr... 2026-03-09T00:29:56.851 INFO:teuthology.orchestra.run.vm05.stdout:Verifying port 0.0.0.0:9283 ... 2026-03-09T00:29:56.851 INFO:teuthology.orchestra.run.vm05.stdout:Verifying port 0.0.0.0:8765 ... 2026-03-09T00:29:57.012 INFO:teuthology.orchestra.run.vm05.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@mgr.a 2026-03-09T00:29:57.012 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@mgr.a.service: Unit ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@mgr.a.service not loaded. 2026-03-09T00:29:57.156 INFO:teuthology.orchestra.run.vm05.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0.target.wants/ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@mgr.a.service → /etc/systemd/system/ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@.service. 2026-03-09T00:29:57.180 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:57 vm05 systemd[1]: Starting Ceph mgr.a for e3e5866c-1b4e-11f1-8647-4d81740f07c0... 2026-03-09T00:29:57.371 INFO:teuthology.orchestra.run.vm05.stdout:firewalld does not appear to be present 2026-03-09T00:29:57.371 INFO:teuthology.orchestra.run.vm05.stdout:Not possible to enable service . firewalld.service is not available 2026-03-09T00:29:57.371 INFO:teuthology.orchestra.run.vm05.stdout:firewalld does not appear to be present 2026-03-09T00:29:57.371 INFO:teuthology.orchestra.run.vm05.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-03-09T00:29:57.371 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for mgr to start... 2026-03-09T00:29:57.371 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for mgr... 2026-03-09T00:29:57.442 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:57 vm05 podman[52587]: 2026-03-09 00:29:57.285935634 +0000 UTC m=+0.019263496 container create 63ee0adcb4613260201a0b200356e7e8e2cb87336094c96162e63f6f8cc53459 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_REF=squid, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.license=GPLv2) 2026-03-09T00:29:57.442 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:57 vm05 podman[52587]: 2026-03-09 00:29:57.351199587 +0000 UTC m=+0.084527449 container init 63ee0adcb4613260201a0b200356e7e8e2cb87336094c96162e63f6f8cc53459 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a, ceph=True, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=squid, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0) 2026-03-09T00:29:57.442 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:57 vm05 podman[52587]: 2026-03-09 00:29:57.357859303 +0000 UTC m=+0.091187165 container start 63ee0adcb4613260201a0b200356e7e8e2cb87336094c96162e63f6f8cc53459 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, ceph=True, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, OSD_FLAVOR=default, CEPH_REF=squid, org.label-schema.build-date=20260223) 2026-03-09T00:29:57.442 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:57 vm05 bash[52587]: 63ee0adcb4613260201a0b200356e7e8e2cb87336094c96162e63f6f8cc53459 2026-03-09T00:29:57.442 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:57 vm05 podman[52587]: 2026-03-09 00:29:57.277837849 +0000 UTC m=+0.011165720 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T00:29:57.442 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:57 vm05 systemd[1]: Started Ceph mgr.a for e3e5866c-1b4e-11f1-8647-4d81740f07c0. 2026-03-09T00:29:57.714 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:57 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:57.467+0000 7feff6896140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T00:29:57.714 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:57 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:57.524+0000 7feff6896140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T00:29:57.722 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout { 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "fsid": "e3e5866c-1b4e-11f1-8647-4d81740f07c0", 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "health": { 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 0 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "a" 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-09T00:29:57.726 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "btime": "2026-03-09T00:29:55:050276+0000", 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "available": false, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "restful" 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "modified": "2026-03-09T00:29:55.051067+0000", 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout } 2026-03-09T00:29:57.727 INFO:teuthology.orchestra.run.vm05.stdout:mgr not available, waiting (1/15)... 2026-03-09T00:29:58.033 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:57 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/4106673895' entity='client.admin' 2026-03-09T00:29:58.033 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:57 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/2110007531' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T00:29:58.284 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:58 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:58.033+0000 7feff6896140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T00:29:58.784 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:58 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:58.391+0000 7feff6896140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T00:29:58.785 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:58 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T00:29:58.785 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:58 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T00:29:58.785 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:58 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: from numpy import show_config as show_numpy_config 2026-03-09T00:29:58.785 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:58 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:58.486+0000 7feff6896140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T00:29:58.785 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:58 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:58.525+0000 7feff6896140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T00:29:58.785 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:58 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:58.603+0000 7feff6896140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T00:29:59.430 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:59 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:59.152+0000 7feff6896140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T00:29:59.430 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:59 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:59.267+0000 7feff6896140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:29:59.430 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:59 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:59.309+0000 7feff6896140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T00:29:59.430 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:59 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:59.347+0000 7feff6896140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T00:29:59.430 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:59 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:59.391+0000 7feff6896140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T00:29:59.766 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:59 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:59.430+0000 7feff6896140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T00:29:59.766 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:59 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:59.619+0000 7feff6896140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T00:29:59.766 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:59 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:59.674+0000 7feff6896140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T00:30:00.034 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:29:59 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:29:59.927+0000 7feff6896140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T00:30:00.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:29:59 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3732637934' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T00:30:00.073 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout { 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "fsid": "e3e5866c-1b4e-11f1-8647-4d81740f07c0", 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "health": { 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 0 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "a" 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:30:00.074 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "btime": "2026-03-09T00:29:55:050276+0000", 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "available": false, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "restful" 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:30:00.075 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T00:30:00.076 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:30:00.076 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-09T00:30:00.076 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:30:00.076 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "modified": "2026-03-09T00:29:55.051067+0000", 2026-03-09T00:30:00.076 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T00:30:00.076 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:30:00.076 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-09T00:30:00.076 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout } 2026-03-09T00:30:00.076 INFO:teuthology.orchestra.run.vm05.stdout:mgr not available, waiting (2/15)... 2026-03-09T00:30:00.327 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:00.244+0000 7feff6896140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T00:30:00.327 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:00.282+0000 7feff6896140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T00:30:00.649 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:00.326+0000 7feff6896140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T00:30:00.649 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:00.410+0000 7feff6896140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T00:30:00.649 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:00.448+0000 7feff6896140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T00:30:00.649 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:00.529+0000 7feff6896140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T00:30:00.988 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:00.649+0000 7feff6896140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:30:00.988 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:00.802+0000 7feff6896140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T00:30:00.988 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:00.841+0000 7feff6896140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T00:30:01.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-mon[52364]: Activating manager daemon a 2026-03-09T00:30:01.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-mon[52364]: mgrmap e2: a(active, starting, since 0.00464989s) 2026-03-09T00:30:01.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-mon[52364]: from='mgr.14100 192.168.123.105:0/3547498883' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T00:30:01.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-mon[52364]: from='mgr.14100 192.168.123.105:0/3547498883' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T00:30:01.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-mon[52364]: from='mgr.14100 192.168.123.105:0/3547498883' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T00:30:01.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-mon[52364]: from='mgr.14100 192.168.123.105:0/3547498883' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:30:01.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-mon[52364]: from='mgr.14100 192.168.123.105:0/3547498883' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-03-09T00:30:01.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-mon[52364]: Manager daemon a is now available 2026-03-09T00:30:01.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-mon[52364]: from='mgr.14100 192.168.123.105:0/3547498883' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-03-09T00:30:01.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-mon[52364]: from='mgr.14100 192.168.123.105:0/3547498883' entity='mgr.a' 2026-03-09T00:30:01.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-mon[52364]: from='mgr.14100 192.168.123.105:0/3547498883' entity='mgr.a' 2026-03-09T00:30:01.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-mon[52364]: from='mgr.14100 192.168.123.105:0/3547498883' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-03-09T00:30:01.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:00 vm05 ceph-mon[52364]: from='mgr.14100 192.168.123.105:0/3547498883' entity='mgr.a' 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout { 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "fsid": "e3e5866c-1b4e-11f1-8647-4d81740f07c0", 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "health": { 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 0 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "a" 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-09T00:30:03.155 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "btime": "2026-03-09T00:29:55:050276+0000", 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "restful" 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ], 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T00:30:03.156 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "modified": "2026-03-09T00:29:55.051067+0000", 2026-03-09T00:30:03.157 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T00:30:03.157 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout }, 2026-03-09T00:30:03.157 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-09T00:30:03.157 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout } 2026-03-09T00:30:03.157 INFO:teuthology.orchestra.run.vm05.stdout:mgr is available 2026-03-09T00:30:03.435 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:03 vm05 ceph-mon[52364]: mgrmap e3: a(active, since 1.00891s) 2026-03-09T00:30:03.435 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:03 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3962799185' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T00:30:03.577 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-09T00:30:03.577 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout [global] 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout fsid = e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_host = [v2:192.168.123.105:3300,v1:192.168.123.105:6789] 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout [mgr] 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout [osd] 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-03-09T00:30:03.578 INFO:teuthology.orchestra.run.vm05.stdout:Enabling cephadm module... 2026-03-09T00:30:04.456 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:04 vm05 ceph-mon[52364]: mgrmap e4: a(active, since 2s) 2026-03-09T00:30:04.456 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:04 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1124052843' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-03-09T00:30:04.456 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:04 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1124052843' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-03-09T00:30:04.456 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:04 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/52769354' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-03-09T00:30:04.784 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:04 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: ignoring --setuser ceph since I am not root 2026-03-09T00:30:04.784 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:04 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: ignoring --setgroup ceph since I am not root 2026-03-09T00:30:04.784 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:04 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:04.560+0000 7f469a2ab140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T00:30:04.784 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:04 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:04.611+0000 7f469a2ab140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T00:30:05.284 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:05 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:05.020+0000 7f469a2ab140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T00:30:05.629 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:05 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/52769354' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-03-09T00:30:05.629 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:05 vm05 ceph-mon[52364]: mgrmap e5: a(active, since 3s) 2026-03-09T00:30:05.629 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:05 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:05.338+0000 7f469a2ab140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T00:30:05.629 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:05 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T00:30:05.629 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:05 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T00:30:05.629 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:05 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: from numpy import show_config as show_numpy_config 2026-03-09T00:30:05.629 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:05 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:05.421+0000 7f469a2ab140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T00:30:05.629 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:05 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:05.458+0000 7f469a2ab140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T00:30:05.629 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:05 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:05.539+0000 7f469a2ab140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T00:30:06.314 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:06 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:06.063+0000 7f469a2ab140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T00:30:06.314 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:06 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:06.181+0000 7f469a2ab140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:30:06.314 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:06 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:06.222+0000 7f469a2ab140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T00:30:06.314 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:06 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:06.268+0000 7f469a2ab140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T00:30:06.314 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:06 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:06.313+0000 7f469a2ab140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T00:30:06.586 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:06 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:06.353+0000 7f469a2ab140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T00:30:06.587 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:06 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:06.531+0000 7f469a2ab140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T00:30:06.918 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:06 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:06.586+0000 7f469a2ab140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T00:30:06.918 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:06 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:06.818+0000 7f469a2ab140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T00:30:07.180 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:07 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:07.140+0000 7f469a2ab140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T00:30:07.180 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:07 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:07.179+0000 7f469a2ab140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T00:30:07.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:07 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1607085346' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-03-09T00:30:07.535 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:07 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:07.221+0000 7f469a2ab140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T00:30:07.535 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:07 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:07.307+0000 7f469a2ab140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T00:30:07.535 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:07 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:07.344+0000 7f469a2ab140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T00:30:07.535 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:07 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:07.421+0000 7f469a2ab140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T00:30:07.798 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:07 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:07.537+0000 7f469a2ab140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:30:07.798 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:07 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:07.676+0000 7f469a2ab140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T00:30:07.798 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:07 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:07.717+0000 7f469a2ab140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T00:30:08.320 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout { 2026-03-09T00:30:08.320 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-03-09T00:30:08.320 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-09T00:30:08.320 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-03-09T00:30:08.320 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-03-09T00:30:08.320 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout } 2026-03-09T00:30:08.320 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for the mgr to restart... 2026-03-09T00:30:08.320 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for mgr epoch 5... 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: Active manager daemon a restarted 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: Activating manager daemon a 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: osdmap e2: 0 total, 0 up, 0 in 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: mgrmap e6: a(active, starting, since 0.344662s) 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: Manager daemon a is now available 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-03-09T00:30:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:08 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-03-09T00:30:09.175 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout { 2026-03-09T00:30:09.175 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-03-09T00:30:09.175 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "initialized": true 2026-03-09T00:30:09.175 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout } 2026-03-09T00:30:09.175 INFO:teuthology.orchestra.run.vm05.stdout:mgr epoch 5 is available 2026-03-09T00:30:09.175 INFO:teuthology.orchestra.run.vm05.stdout:Setting orchestrator backend to cephadm... 2026-03-09T00:30:09.592 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:09 vm05 ceph-mon[52364]: Found migration_current of "None". Setting to last migration. 2026-03-09T00:30:09.592 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:09 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' 2026-03-09T00:30:09.592 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:09 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' 2026-03-09T00:30:09.592 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:09 vm05 ceph-mon[52364]: mgrmap e7: a(active, since 1.312s) 2026-03-09T00:30:09.592 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:09 vm05 ceph-mon[52364]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-03-09T00:30:09.592 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:09 vm05 ceph-mon[52364]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-03-09T00:30:09.592 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:09 vm05 ceph-mon[52364]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:09.592 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:09 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' 2026-03-09T00:30:09.592 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:09 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:09.974 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout value unchanged 2026-03-09T00:30:09.974 INFO:teuthology.orchestra.run.vm05.stdout:Generating ssh key... 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: Generating public/private ed25519 key pair. 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: Your identification has been saved in /tmp/tmp0iphqf7t/key 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: Your public key has been saved in /tmp/tmp0iphqf7t/key.pub 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: The key fingerprint is: 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: SHA256:HY4ZOZwP2T5rnuAPRY0g2omr3zJrooVUTLdXfFk+New ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: The key's randomart image is: 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: +--[ED25519 256]--+ 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: | . .. o. o..o | 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: | o .+.+.B =. ...| 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: | oo.o.O * .o. | 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: | . .. % . .E | 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: | . . S B | 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: |.. . . o | 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: |. o o o | 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: | ...+. . = . | 2026-03-09T00:30:10.492 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: |.. oo+. ..+ | 2026-03-09T00:30:10.493 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: +----[SHA256]-----+ 2026-03-09T00:30:10.765 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-mon[52364]: [09/Mar/2026:00:30:09] ENGINE Bus STARTING 2026-03-09T00:30:10.765 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-mon[52364]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:10.765 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-mon[52364]: [09/Mar/2026:00:30:09] ENGINE Serving on https://192.168.123.105:7150 2026-03-09T00:30:10.765 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-mon[52364]: [09/Mar/2026:00:30:09] ENGINE Client ('192.168.123.105', 55564) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T00:30:10.765 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-mon[52364]: [09/Mar/2026:00:30:10] ENGINE Serving on http://192.168.123.105:8765 2026-03-09T00:30:10.765 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-mon[52364]: [09/Mar/2026:00:30:10] ENGINE Bus STARTED 2026-03-09T00:30:10.765 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:10.765 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-mon[52364]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:10.765 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-mon[52364]: Generating ssh key... 2026-03-09T00:30:10.765 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' 2026-03-09T00:30:10.765 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:10 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' 2026-03-09T00:30:10.777 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDlowzdOzTkj8PFCqk0bNPub8eAtpgEuxXSVZglhhidm ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:30:10.777 INFO:teuthology.orchestra.run.vm05.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-03-09T00:30:10.777 INFO:teuthology.orchestra.run.vm05.stdout:Adding key to root@localhost authorized_keys... 2026-03-09T00:30:10.777 INFO:teuthology.orchestra.run.vm05.stdout:Adding host vm05... 2026-03-09T00:30:11.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:11 vm05 ceph-mon[52364]: mgrmap e8: a(active, since 2s) 2026-03-09T00:30:11.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:11 vm05 ceph-mon[52364]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:11.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:11 vm05 ceph-mon[52364]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "vm05", "addr": "192.168.123.105", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:11.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:11 vm05 ceph-mon[52364]: Deploying cephadm binary to vm05 2026-03-09T00:30:12.764 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout Added host 'vm05' with addr '192.168.123.105' 2026-03-09T00:30:12.764 INFO:teuthology.orchestra.run.vm05.stdout:Deploying unmanaged mon service... 2026-03-09T00:30:13.236 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-03-09T00:30:13.236 INFO:teuthology.orchestra.run.vm05.stdout:Deploying unmanaged mgr service... 2026-03-09T00:30:13.685 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-03-09T00:30:13.751 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:13 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' 2026-03-09T00:30:13.751 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:13 vm05 ceph-mon[52364]: Added host vm05 2026-03-09T00:30:13.751 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:13 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:13.751 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:13 vm05 ceph-mon[52364]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:13.751 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:13 vm05 ceph-mon[52364]: Saving service mon spec with placement count:5 2026-03-09T00:30:13.751 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:13 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' 2026-03-09T00:30:13.751 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:13 vm05 ceph-mon[52364]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:13.751 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:13 vm05 ceph-mon[52364]: Saving service mgr spec with placement count:2 2026-03-09T00:30:13.751 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:13 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' 2026-03-09T00:30:14.623 INFO:teuthology.orchestra.run.vm05.stdout:Enabling the dashboard module... 2026-03-09T00:30:14.966 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:14 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/2532789796' entity='client.admin' 2026-03-09T00:30:14.966 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:14 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/996002701' entity='client.admin' 2026-03-09T00:30:14.966 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:14 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' 2026-03-09T00:30:14.966 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:14 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' 2026-03-09T00:30:14.966 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:14 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/2523811186' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-03-09T00:30:16.034 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:15 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: ignoring --setuser ceph since I am not root 2026-03-09T00:30:16.035 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:15 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: ignoring --setgroup ceph since I am not root 2026-03-09T00:30:16.035 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:15 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:15.920+0000 7f702a9d1140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T00:30:16.035 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:15 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:15.991+0000 7f702a9d1140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T00:30:16.332 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:16 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' 2026-03-09T00:30:16.332 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:16 vm05 ceph-mon[52364]: from='mgr.14118 192.168.123.105:0/3834031015' entity='mgr.a' 2026-03-09T00:30:16.332 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:16 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/2523811186' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-03-09T00:30:16.332 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:16 vm05 ceph-mon[52364]: mgrmap e9: a(active, since 8s) 2026-03-09T00:30:16.468 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout { 2026-03-09T00:30:16.468 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-03-09T00:30:16.469 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-09T00:30:16.469 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-03-09T00:30:16.469 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-03-09T00:30:16.469 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout } 2026-03-09T00:30:16.469 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for the mgr to restart... 2026-03-09T00:30:16.469 INFO:teuthology.orchestra.run.vm05.stdout:Waiting for mgr epoch 9... 2026-03-09T00:30:16.587 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:16 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:16.508+0000 7f702a9d1140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T00:30:17.226 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:16 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:16.850+0000 7f702a9d1140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T00:30:17.226 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:16 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T00:30:17.226 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:16 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T00:30:17.226 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:16 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: from numpy import show_config as show_numpy_config 2026-03-09T00:30:17.226 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:16 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:16.939+0000 7f702a9d1140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T00:30:17.226 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:16 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:16.979+0000 7f702a9d1140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T00:30:17.226 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:17 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:17.049+0000 7f702a9d1140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T00:30:17.534 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:17 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/262254699' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-03-09T00:30:17.864 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:17 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:17.577+0000 7f702a9d1140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T00:30:17.864 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:17 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:17.697+0000 7f702a9d1140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:30:17.864 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:17 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:17.739+0000 7f702a9d1140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T00:30:17.864 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:17 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:17.776+0000 7f702a9d1140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T00:30:17.864 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:17 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:17.821+0000 7f702a9d1140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T00:30:17.864 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:17 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:17.864+0000 7f702a9d1140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T00:30:18.285 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:18 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:18.044+0000 7f702a9d1140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T00:30:18.285 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:18 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:18.096+0000 7f702a9d1140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T00:30:18.644 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:18 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:18.328+0000 7f702a9d1140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T00:30:18.914 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:18 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:18.644+0000 7f702a9d1140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T00:30:18.914 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:18 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:18.682+0000 7f702a9d1140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T00:30:18.914 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:18 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:18.722+0000 7f702a9d1140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T00:30:18.914 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:18 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:18.799+0000 7f702a9d1140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T00:30:18.914 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:18 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:18.836+0000 7f702a9d1140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T00:30:18.914 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:18 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:18.914+0000 7f702a9d1140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T00:30:19.184 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:19.032+0000 7f702a9d1140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T00:30:19.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-mon[52364]: Active manager daemon a restarted 2026-03-09T00:30:19.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-mon[52364]: Activating manager daemon a 2026-03-09T00:30:19.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-mon[52364]: osdmap e3: 0 total, 0 up, 0 in 2026-03-09T00:30:19.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-mon[52364]: mgrmap e10: a(active, starting, since 0.0050609s) 2026-03-09T00:30:19.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:30:19.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-03-09T00:30:19.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T00:30:19.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T00:30:19.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T00:30:19.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-mon[52364]: Manager daemon a is now available 2026-03-09T00:30:19.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:19.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-03-09T00:30:19.535 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:19.183+0000 7f702a9d1140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T00:30:19.535 INFO:journalctl@ceph.mgr.a.vm05.stdout:Mar 09 00:30:19 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-mgr-a[52598]: 2026-03-09T00:30:19.227+0000 7f702a9d1140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T00:30:20.434 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout { 2026-03-09T00:30:20.434 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-03-09T00:30:20.434 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout "initialized": true 2026-03-09T00:30:20.434 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout } 2026-03-09T00:30:20.434 INFO:teuthology.orchestra.run.vm05.stdout:mgr epoch 9 is available 2026-03-09T00:30:20.434 INFO:teuthology.orchestra.run.vm05.stdout:Generating a dashboard self-signed certificate... 2026-03-09T00:30:20.510 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:20 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-03-09T00:30:20.510 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:20 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:20.510 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:20 vm05 ceph-mon[52364]: mgrmap e11: a(active, since 1.00734s) 2026-03-09T00:30:20.961 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-03-09T00:30:20.961 INFO:teuthology.orchestra.run.vm05.stdout:Creating initial admin user... 2026-03-09T00:30:21.494 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$lNUaBChyvtau.1kmkNe78OR9KP3LQzejQphFPyCTDIZgBria6l7DO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1773016221, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-03-09T00:30:21.494 INFO:teuthology.orchestra.run.vm05.stdout:Fetching dashboard port number... 2026-03-09T00:30:21.611 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:21.611 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:21 vm05 ceph-mon[52364]: [09/Mar/2026:00:30:20] ENGINE Bus STARTING 2026-03-09T00:30:21.611 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:21 vm05 ceph-mon[52364]: [09/Mar/2026:00:30:20] ENGINE Serving on https://192.168.123.105:7150 2026-03-09T00:30:21.611 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:21 vm05 ceph-mon[52364]: [09/Mar/2026:00:30:20] ENGINE Client ('192.168.123.105', 46794) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T00:30:21.611 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:21 vm05 ceph-mon[52364]: [09/Mar/2026:00:30:20] ENGINE Serving on http://192.168.123.105:8765 2026-03-09T00:30:21.611 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:21 vm05 ceph-mon[52364]: [09/Mar/2026:00:30:20] ENGINE Bus STARTED 2026-03-09T00:30:21.611 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:21 vm05 ceph-mon[52364]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:21.611 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:21.611 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:21.865 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stdout 8443 2026-03-09T00:30:21.865 INFO:teuthology.orchestra.run.vm05.stdout:firewalld does not appear to be present 2026-03-09T00:30:21.865 INFO:teuthology.orchestra.run.vm05.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-03-09T00:30:21.866 INFO:teuthology.orchestra.run.vm05.stdout:Ceph Dashboard is now available at: 2026-03-09T00:30:21.866 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:30:21.866 INFO:teuthology.orchestra.run.vm05.stdout: URL: https://vm05.local:8443/ 2026-03-09T00:30:21.866 INFO:teuthology.orchestra.run.vm05.stdout: User: admin 2026-03-09T00:30:21.866 INFO:teuthology.orchestra.run.vm05.stdout: Password: zabi1lpojm 2026-03-09T00:30:21.867 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:30:21.867 INFO:teuthology.orchestra.run.vm05.stdout:Saving cluster configuration to /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/config directory 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout:Or, if you are only running a single cluster on this host: 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout:Please consider enabling telemetry to help improve Ceph: 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout: ceph telemetry on 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout:For more information see: 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:30:22.280 INFO:teuthology.orchestra.run.vm05.stdout:Bootstrap complete. 2026-03-09T00:30:22.317 INFO:tasks.cephadm:Fetching config... 2026-03-09T00:30:22.317 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:30:22.317 DEBUG:teuthology.orchestra.run.vm05:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-03-09T00:30:22.339 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-03-09T00:30:22.339 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:30:22.339 DEBUG:teuthology.orchestra.run.vm05:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-03-09T00:30:22.411 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:22 vm05 ceph-mon[52364]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:22.411 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:22 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:22.411 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:22 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1725035959' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-03-09T00:30:22.411 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:22 vm05 ceph-mon[52364]: mgrmap e12: a(active, since 2s) 2026-03-09T00:30:22.411 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:22 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/2887565065' entity='client.admin' 2026-03-09T00:30:22.413 INFO:tasks.cephadm:Fetching mon keyring... 2026-03-09T00:30:22.413 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:30:22.413 DEBUG:teuthology.orchestra.run.vm05:> sudo dd if=/var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/keyring of=/dev/stdout 2026-03-09T00:30:22.493 INFO:tasks.cephadm:Fetching pub ssh key... 2026-03-09T00:30:22.494 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:30:22.494 DEBUG:teuthology.orchestra.run.vm05:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-03-09T00:30:22.558 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-03-09T00:30:22.558 DEBUG:teuthology.orchestra.run.vm05:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDlowzdOzTkj8PFCqk0bNPub8eAtpgEuxXSVZglhhidm ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-03-09T00:30:22.663 INFO:teuthology.orchestra.run.vm05.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDlowzdOzTkj8PFCqk0bNPub8eAtpgEuxXSVZglhhidm ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:30:22.684 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-03-09T00:30:22.885 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:30:23.316 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-03-09T00:30:23.316 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-03-09T00:30:23.588 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:30:24.046 INFO:tasks.cephadm:Setting crush tunables to default 2026-03-09T00:30:24.046 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph osd crush tunables default 2026-03-09T00:30:24.239 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:30:24.283 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:24 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/4095868142' entity='client.admin' 2026-03-09T00:30:24.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:24 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:25.157 INFO:teuthology.orchestra.run.vm05.stderr:adjusted tunables profile to default 2026-03-09T00:30:25.318 INFO:tasks.cephadm:Adding mon.a on vm05 2026-03-09T00:30:25.319 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph orch apply mon '1;vm05:192.168.123.105=a' 2026-03-09T00:30:25.499 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:30:25.524 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:25 vm05 ceph-mon[52364]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:25.525 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:25 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1878876263' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-03-09T00:30:25.525 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:25 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:25.525 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:25 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:25.525 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:25 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:vm05", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:25.525 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:25 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:25.525 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:25 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:25.525 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:25 vm05 ceph-mon[52364]: Updating vm05:/etc/ceph/ceph.conf 2026-03-09T00:30:25.750 INFO:teuthology.orchestra.run.vm05.stdout:Scheduled mon update... 2026-03-09T00:30:25.913 INFO:tasks.cephadm:Waiting for 1 mons in monmap... 2026-03-09T00:30:25.913 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph mon dump -f json 2026-03-09T00:30:26.158 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: Updating vm05:/var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/config/ceph.conf 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: Updating vm05:/etc/ceph/ceph.client.admin.keyring 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1878876263' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: Updating vm05:/var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/config/ceph.client.admin.keyring 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "1;vm05:192.168.123.105=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: Saving service mon spec with placement vm05:192.168.123.105=a;count:1 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:26.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:26.221 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:30:26.482 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:26.482 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:26.482 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:26.482 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:26.482 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:26.482 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:26.482 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:26.482 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: Reconfiguring mon.a (unknown last config time)... 2026-03-09T00:30:26.482 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T00:30:26.482 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T00:30:26.482 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:26.482 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:26 vm05 ceph-mon[52364]: Reconfiguring daemon mon.a on vm05 2026-03-09T00:30:26.483 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:30:26.483 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":1,"fsid":"e3e5866c-1b4e-11f1-8647-4d81740f07c0","modified":"2026-03-09T00:29:53.638126Z","created":"2026-03-09T00:29:53.638126Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:3300","nonce":0},{"type":"v1","addr":"192.168.123.105:6789","nonce":0}]},"addr":"192.168.123.105:6789/0","public_addr":"192.168.123.105:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-03-09T00:30:26.483 INFO:teuthology.orchestra.run.vm05.stderr:dumped monmap epoch 1 2026-03-09T00:30:26.633 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-03-09T00:30:26.633 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph config generate-minimal-conf 2026-03-09T00:30:26.799 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:30:27.014 INFO:teuthology.orchestra.run.vm05.stdout:# minimal ceph.conf for e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:30:27.014 INFO:teuthology.orchestra.run.vm05.stdout:[global] 2026-03-09T00:30:27.014 INFO:teuthology.orchestra.run.vm05.stdout: fsid = e3e5866c-1b4e-11f1-8647-4d81740f07c0 2026-03-09T00:30:27.014 INFO:teuthology.orchestra.run.vm05.stdout: mon_host = [v2:192.168.123.105:3300/0,v1:192.168.123.105:6789/0] 2026-03-09T00:30:27.162 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-03-09T00:30:27.163 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:30:27.163 DEBUG:teuthology.orchestra.run.vm05:> sudo dd of=/etc/ceph/ceph.conf 2026-03-09T00:30:27.193 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:30:27.193 DEBUG:teuthology.orchestra.run.vm05:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-03-09T00:30:27.260 INFO:tasks.cephadm:Adding mgr.a on vm05 2026-03-09T00:30:27.260 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph orch apply mgr '1;vm05=a' 2026-03-09T00:30:27.459 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:30:27.487 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:27 vm05 ceph-mon[52364]: mgrmap e13: a(active, since 6s) 2026-03-09T00:30:27.487 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:27 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:27.487 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:27 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:27.487 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:27 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3598279993' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T00:30:27.487 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:27 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/2311078701' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:27.710 INFO:teuthology.orchestra.run.vm05.stdout:Scheduled mgr update... 2026-03-09T00:30:27.899 INFO:tasks.cephadm:Deploying OSDs... 2026-03-09T00:30:27.899 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:30:27.899 DEBUG:teuthology.orchestra.run.vm05:> dd if=/scratch_devs of=/dev/stdout 2026-03-09T00:30:27.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T00:30:27.919 DEBUG:teuthology.orchestra.run.vm05:> ls /dev/[sv]d? 2026-03-09T00:30:27.981 INFO:teuthology.orchestra.run.vm05.stdout:/dev/vda 2026-03-09T00:30:27.981 INFO:teuthology.orchestra.run.vm05.stdout:/dev/vdb 2026-03-09T00:30:27.981 INFO:teuthology.orchestra.run.vm05.stdout:/dev/vdc 2026-03-09T00:30:27.981 INFO:teuthology.orchestra.run.vm05.stdout:/dev/vdd 2026-03-09T00:30:27.981 INFO:teuthology.orchestra.run.vm05.stdout:/dev/vde 2026-03-09T00:30:27.982 WARNING:teuthology.misc:Removing root device: /dev/vda from device list 2026-03-09T00:30:27.982 DEBUG:teuthology.misc:devs=['/dev/vdb', '/dev/vdc', '/dev/vdd', '/dev/vde'] 2026-03-09T00:30:27.982 DEBUG:teuthology.orchestra.run.vm05:> stat /dev/vdb 2026-03-09T00:30:28.038 INFO:teuthology.orchestra.run.vm05.stdout: File: /dev/vdb 2026-03-09T00:30:28.038 INFO:teuthology.orchestra.run.vm05.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T00:30:28.038 INFO:teuthology.orchestra.run.vm05.stdout:Device: 6h/6d Inode: 221 Links: 1 Device type: fc,10 2026-03-09T00:30:28.039 INFO:teuthology.orchestra.run.vm05.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T00:30:28.039 INFO:teuthology.orchestra.run.vm05.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T00:30:28.039 INFO:teuthology.orchestra.run.vm05.stdout:Access: 2026-03-09 00:30:24.442335488 +0000 2026-03-09T00:30:28.039 INFO:teuthology.orchestra.run.vm05.stdout:Modify: 2026-03-09 00:27:25.704149761 +0000 2026-03-09T00:30:28.039 INFO:teuthology.orchestra.run.vm05.stdout:Change: 2026-03-09 00:27:25.704149761 +0000 2026-03-09T00:30:28.039 INFO:teuthology.orchestra.run.vm05.stdout: Birth: 2026-03-09 00:24:45.295000000 +0000 2026-03-09T00:30:28.039 DEBUG:teuthology.orchestra.run.vm05:> sudo dd if=/dev/vdb of=/dev/null count=1 2026-03-09T00:30:28.102 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records in 2026-03-09T00:30:28.102 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records out 2026-03-09T00:30:28.102 INFO:teuthology.orchestra.run.vm05.stderr:512 bytes copied, 0.000191919 s, 2.7 MB/s 2026-03-09T00:30:28.103 DEBUG:teuthology.orchestra.run.vm05:> ! mount | grep -v devtmpfs | grep -q /dev/vdb 2026-03-09T00:30:28.164 DEBUG:teuthology.orchestra.run.vm05:> stat /dev/vdc 2026-03-09T00:30:28.223 INFO:teuthology.orchestra.run.vm05.stdout: File: /dev/vdc 2026-03-09T00:30:28.223 INFO:teuthology.orchestra.run.vm05.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T00:30:28.223 INFO:teuthology.orchestra.run.vm05.stdout:Device: 6h/6d Inode: 224 Links: 1 Device type: fc,20 2026-03-09T00:30:28.223 INFO:teuthology.orchestra.run.vm05.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T00:30:28.223 INFO:teuthology.orchestra.run.vm05.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T00:30:28.223 INFO:teuthology.orchestra.run.vm05.stdout:Access: 2026-03-09 00:30:24.489335533 +0000 2026-03-09T00:30:28.223 INFO:teuthology.orchestra.run.vm05.stdout:Modify: 2026-03-09 00:27:25.729149786 +0000 2026-03-09T00:30:28.223 INFO:teuthology.orchestra.run.vm05.stdout:Change: 2026-03-09 00:27:25.729149786 +0000 2026-03-09T00:30:28.223 INFO:teuthology.orchestra.run.vm05.stdout: Birth: 2026-03-09 00:24:45.302000000 +0000 2026-03-09T00:30:28.223 DEBUG:teuthology.orchestra.run.vm05:> sudo dd if=/dev/vdc of=/dev/null count=1 2026-03-09T00:30:28.288 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records in 2026-03-09T00:30:28.288 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records out 2026-03-09T00:30:28.288 INFO:teuthology.orchestra.run.vm05.stderr:512 bytes copied, 0.000143789 s, 3.6 MB/s 2026-03-09T00:30:28.289 DEBUG:teuthology.orchestra.run.vm05:> ! mount | grep -v devtmpfs | grep -q /dev/vdc 2026-03-09T00:30:28.347 DEBUG:teuthology.orchestra.run.vm05:> stat /dev/vdd 2026-03-09T00:30:28.403 INFO:teuthology.orchestra.run.vm05.stdout: File: /dev/vdd 2026-03-09T00:30:28.403 INFO:teuthology.orchestra.run.vm05.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T00:30:28.403 INFO:teuthology.orchestra.run.vm05.stdout:Device: 6h/6d Inode: 233 Links: 1 Device type: fc,30 2026-03-09T00:30:28.403 INFO:teuthology.orchestra.run.vm05.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T00:30:28.403 INFO:teuthology.orchestra.run.vm05.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T00:30:28.403 INFO:teuthology.orchestra.run.vm05.stdout:Access: 2026-03-09 00:30:24.514335557 +0000 2026-03-09T00:30:28.403 INFO:teuthology.orchestra.run.vm05.stdout:Modify: 2026-03-09 00:27:25.714149771 +0000 2026-03-09T00:30:28.403 INFO:teuthology.orchestra.run.vm05.stdout:Change: 2026-03-09 00:27:25.714149771 +0000 2026-03-09T00:30:28.403 INFO:teuthology.orchestra.run.vm05.stdout: Birth: 2026-03-09 00:24:45.313000000 +0000 2026-03-09T00:30:28.403 DEBUG:teuthology.orchestra.run.vm05:> sudo dd if=/dev/vdd of=/dev/null count=1 2026-03-09T00:30:28.466 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records in 2026-03-09T00:30:28.466 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records out 2026-03-09T00:30:28.466 INFO:teuthology.orchestra.run.vm05.stderr:512 bytes copied, 0.000166782 s, 3.1 MB/s 2026-03-09T00:30:28.467 DEBUG:teuthology.orchestra.run.vm05:> ! mount | grep -v devtmpfs | grep -q /dev/vdd 2026-03-09T00:30:28.526 DEBUG:teuthology.orchestra.run.vm05:> stat /dev/vde 2026-03-09T00:30:28.582 INFO:teuthology.orchestra.run.vm05.stdout: File: /dev/vde 2026-03-09T00:30:28.582 INFO:teuthology.orchestra.run.vm05.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T00:30:28.582 INFO:teuthology.orchestra.run.vm05.stdout:Device: 6h/6d Inode: 257 Links: 1 Device type: fc,40 2026-03-09T00:30:28.582 INFO:teuthology.orchestra.run.vm05.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T00:30:28.582 INFO:teuthology.orchestra.run.vm05.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T00:30:28.582 INFO:teuthology.orchestra.run.vm05.stdout:Access: 2026-03-09 00:30:24.537335579 +0000 2026-03-09T00:30:28.582 INFO:teuthology.orchestra.run.vm05.stdout:Modify: 2026-03-09 00:27:25.716149773 +0000 2026-03-09T00:30:28.582 INFO:teuthology.orchestra.run.vm05.stdout:Change: 2026-03-09 00:27:25.716149773 +0000 2026-03-09T00:30:28.582 INFO:teuthology.orchestra.run.vm05.stdout: Birth: 2026-03-09 00:24:45.322000000 +0000 2026-03-09T00:30:28.582 DEBUG:teuthology.orchestra.run.vm05:> sudo dd if=/dev/vde of=/dev/null count=1 2026-03-09T00:30:28.644 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records in 2026-03-09T00:30:28.644 INFO:teuthology.orchestra.run.vm05.stderr:1+0 records out 2026-03-09T00:30:28.644 INFO:teuthology.orchestra.run.vm05.stderr:512 bytes copied, 0.000135944 s, 3.8 MB/s 2026-03-09T00:30:28.645 DEBUG:teuthology.orchestra.run.vm05:> ! mount | grep -v devtmpfs | grep -q /dev/vde 2026-03-09T00:30:28.700 INFO:tasks.cephadm:Deploying osd.0 on vm05 with /dev/vde... 2026-03-09T00:30:28.701 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- lvm zap /dev/vde 2026-03-09T00:30:28.906 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;vm05=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: Saving service mgr spec with placement vm05=a;count:1 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: Reconfiguring mgr.a (unknown last config time)... 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: Reconfiguring daemon mgr.a on vm05 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:28.930 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:28 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:29.920 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:30:29.938 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph orch daemon add osd vm05:/dev/vde 2026-03-09T00:30:30.118 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:30:30.423 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:30 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:30.423 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:30 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:30.423 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:30 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:31.686 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:31 vm05 ceph-mon[52364]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm05:/dev/vde", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:31.686 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:31 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/698078082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfb051b5-1988-4463-a1c8-87f9f52d090c"}]: dispatch 2026-03-09T00:30:31.686 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:31 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/698078082' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfb051b5-1988-4463-a1c8-87f9f52d090c"}]': finished 2026-03-09T00:30:31.686 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:31 vm05 ceph-mon[52364]: osdmap e5: 1 total, 0 up, 1 in 2026-03-09T00:30:31.686 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:31 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:32.784 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:32 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3062368693' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:35.905 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:35 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-03-09T00:30:35.905 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:35 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:37.015 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:36 vm05 ceph-mon[52364]: Deploying daemon osd.0 on vm05 2026-03-09T00:30:38.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:38 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:38.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:38 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:38.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:38 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:39.299 INFO:teuthology.orchestra.run.vm05.stdout:Created osd(s) 0 on host 'vm05' 2026-03-09T00:30:39.463 DEBUG:teuthology.orchestra.run.vm05:osd.0> sudo journalctl -f -n 0 -u ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@osd.0.service 2026-03-09T00:30:39.465 INFO:tasks.cephadm:Deploying osd.1 on vm05 with /dev/vdd... 2026-03-09T00:30:39.465 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- lvm zap /dev/vdd 2026-03-09T00:30:39.708 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:39 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:39.708 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:39 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:39.708 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:39 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:39.708 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:39 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:39.708 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:39 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:39.708 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:39 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:39.708 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:39 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:39.708 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:39 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:39.708 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 09 00:30:39 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-osd-0[64628]: 2026-03-09T00:30:39.707+0000 7f893ffc6740 -1 osd.0 0 log_to_monitors true 2026-03-09T00:30:39.800 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:30:40.701 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:40 vm05 ceph-mon[52364]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:40.701 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:40 vm05 ceph-mon[52364]: from='osd.0 [v2:192.168.123.105:6802/3300718180,v1:192.168.123.105:6803/3300718180]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T00:30:41.548 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:30:41.566 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph orch daemon add osd vm05:/dev/vdd 2026-03-09T00:30:41.627 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:41 vm05 ceph-mon[52364]: from='osd.0 [v2:192.168.123.105:6802/3300718180,v1:192.168.123.105:6803/3300718180]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]': finished 2026-03-09T00:30:41.627 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:41 vm05 ceph-mon[52364]: osdmap e6: 1 total, 0 up, 1 in 2026-03-09T00:30:41.627 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:41 vm05 ceph-mon[52364]: from='osd.0 [v2:192.168.123.105:6802/3300718180,v1:192.168.123.105:6803/3300718180]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm05", "root=default"]}]: dispatch 2026-03-09T00:30:41.627 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:41 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:41.627 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:41 vm05 ceph-mon[52364]: Detected new or changed devices on vm05 2026-03-09T00:30:41.627 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:41 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:41.627 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:41 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:41.627 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:41 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:41.627 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:41 vm05 ceph-mon[52364]: Adjusting osd_memory_target on vm05 to 257.0M 2026-03-09T00:30:41.627 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:41 vm05 ceph-mon[52364]: Unable to set osd_memory_target on vm05 to 269536460: error parsing value: Value '269536460' is below minimum 939524096 2026-03-09T00:30:41.627 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:41 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:41.627 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:41 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:41.627 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:41 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:41.741 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:30:42.035 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 09 00:30:41 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-osd-0[64628]: 2026-03-09T00:30:41.626+0000 7f893bf47640 -1 osd.0 0 waiting for initial osdmap 2026-03-09T00:30:42.035 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 09 00:30:41 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-osd-0[64628]: 2026-03-09T00:30:41.633+0000 7f8937d71640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T00:30:42.694 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:42 vm05 ceph-mon[52364]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:42.695 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:42 vm05 ceph-mon[52364]: from='osd.0 [v2:192.168.123.105:6802/3300718180,v1:192.168.123.105:6803/3300718180]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm05", "root=default"]}]': finished 2026-03-09T00:30:42.695 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:42 vm05 ceph-mon[52364]: osdmap e7: 1 total, 0 up, 1 in 2026-03-09T00:30:42.695 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:42 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:42.695 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:42 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:42.695 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:42 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:42.695 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:42 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:42.695 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:42 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:44.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:43 vm05 ceph-mon[52364]: purged_snaps scrub starts 2026-03-09T00:30:44.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:43 vm05 ceph-mon[52364]: purged_snaps scrub ok 2026-03-09T00:30:44.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:43 vm05 ceph-mon[52364]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm05:/dev/vdd", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:44.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:43 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:44.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:43 vm05 ceph-mon[52364]: osd.0 [v2:192.168.123.105:6802/3300718180,v1:192.168.123.105:6803/3300718180] boot 2026-03-09T00:30:44.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:43 vm05 ceph-mon[52364]: osdmap e8: 1 total, 1 up, 1 in 2026-03-09T00:30:44.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:43 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T00:30:44.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:43 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3356010067' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9057b8c-a8e2-4ab2-84ca-505384166cca"}]: dispatch 2026-03-09T00:30:44.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:43 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3356010067' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9057b8c-a8e2-4ab2-84ca-505384166cca"}]': finished 2026-03-09T00:30:44.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:43 vm05 ceph-mon[52364]: osdmap e9: 2 total, 1 up, 2 in 2026-03-09T00:30:44.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:43 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:44.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:43 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3236290912' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:45.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:44 vm05 ceph-mon[52364]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T00:30:46.968 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:46 vm05 ceph-mon[52364]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:48.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:47 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-03-09T00:30:48.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:47 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:48.987 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:48 vm05 ceph-mon[52364]: Deploying daemon osd.1 on vm05 2026-03-09T00:30:48.987 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:48 vm05 ceph-mon[52364]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:50.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:49 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:50.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:49 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:50.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:49 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:50.553 INFO:teuthology.orchestra.run.vm05.stdout:Created osd(s) 1 on host 'vm05' 2026-03-09T00:30:50.705 DEBUG:teuthology.orchestra.run.vm05:osd.1> sudo journalctl -f -n 0 -u ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@osd.1.service 2026-03-09T00:30:50.706 INFO:tasks.cephadm:Deploying osd.2 on vm05 with /dev/vdc... 2026-03-09T00:30:50.706 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- lvm zap /dev/vdc 2026-03-09T00:30:50.942 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:50 vm05 ceph-mon[52364]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:50.942 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:50 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:50.942 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:50 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:50.942 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:50 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:50.942 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:50 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:50.942 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:50 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:50.942 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:50 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:30:50.942 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:50 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:50.942 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:50 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:51.034 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:30:51.282 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 09 00:30:50 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-osd-1[70175]: 2026-03-09T00:30:50.941+0000 7eff90306740 -1 osd.1 0 log_to_monitors true 2026-03-09T00:30:52.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:51 vm05 ceph-mon[52364]: from='osd.1 [v2:192.168.123.105:6810/1566487350,v1:192.168.123.105:6811/1566487350]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-09T00:30:52.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:51 vm05 ceph-mon[52364]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:52.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:51 vm05 ceph-mon[52364]: Detected new or changed devices on vm05 2026-03-09T00:30:52.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:51 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:52.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:51 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:52.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:51 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:52.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:51 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:30:52.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:51 vm05 ceph-mon[52364]: Adjusting osd_memory_target on vm05 to 128.5M 2026-03-09T00:30:52.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:51 vm05 ceph-mon[52364]: Unable to set osd_memory_target on vm05 to 134768230: error parsing value: Value '134768230' is below minimum 939524096 2026-03-09T00:30:52.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:51 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:52.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:51 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:30:52.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:51 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:30:52.560 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:30:52.579 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph orch daemon add osd vm05:/dev/vdc 2026-03-09T00:30:52.748 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:30:53.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:52 vm05 ceph-mon[52364]: from='osd.1 [v2:192.168.123.105:6810/1566487350,v1:192.168.123.105:6811/1566487350]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]': finished 2026-03-09T00:30:53.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:52 vm05 ceph-mon[52364]: osdmap e10: 2 total, 1 up, 2 in 2026-03-09T00:30:53.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:52 vm05 ceph-mon[52364]: from='osd.1 [v2:192.168.123.105:6810/1566487350,v1:192.168.123.105:6811/1566487350]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm05", "root=default"]}]: dispatch 2026-03-09T00:30:53.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:52 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:54.013 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:53 vm05 ceph-mon[52364]: from='osd.1 [v2:192.168.123.105:6810/1566487350,v1:192.168.123.105:6811/1566487350]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm05", "root=default"]}]': finished 2026-03-09T00:30:54.013 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:53 vm05 ceph-mon[52364]: osdmap e11: 2 total, 1 up, 2 in 2026-03-09T00:30:54.013 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:53 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:54.013 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:53 vm05 ceph-mon[52364]: from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm05:/dev/vdc", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:30:54.013 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:53 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T00:30:54.013 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:53 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T00:30:54.013 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:53 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:54.014 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:53 vm05 ceph-mon[52364]: pgmap v18: 0 pgs: ; 0 B data, 26 MiB used, 20 GiB / 20 GiB avail 2026-03-09T00:30:54.014 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:53 vm05 ceph-mon[52364]: from='osd.1 [v2:192.168.123.105:6810/1566487350,v1:192.168.123.105:6811/1566487350]' entity='osd.1' 2026-03-09T00:30:54.014 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 09 00:30:53 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-osd-1[70175]: 2026-03-09T00:30:53.757+0000 7eff8c287640 -1 osd.1 0 waiting for initial osdmap 2026-03-09T00:30:54.014 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 09 00:30:53 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-osd-1[70175]: 2026-03-09T00:30:53.765+0000 7eff878b0640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T00:30:55.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:54 vm05 ceph-mon[52364]: purged_snaps scrub starts 2026-03-09T00:30:55.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:54 vm05 ceph-mon[52364]: purged_snaps scrub ok 2026-03-09T00:30:55.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:54 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:55.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:54 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3082917777' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e7609c0-3185-4d62-9ed6-455a8c75d0e2"}]: dispatch 2026-03-09T00:30:55.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:54 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3082917777' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e7609c0-3185-4d62-9ed6-455a8c75d0e2"}]': finished 2026-03-09T00:30:55.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:54 vm05 ceph-mon[52364]: osd.1 [v2:192.168.123.105:6810/1566487350,v1:192.168.123.105:6811/1566487350] boot 2026-03-09T00:30:55.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:54 vm05 ceph-mon[52364]: osdmap e12: 3 total, 2 up, 3 in 2026-03-09T00:30:55.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:54 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T00:30:55.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:54 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:55.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:54 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1276271000' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T00:30:56.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:55 vm05 ceph-mon[52364]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:57.159 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:56 vm05 ceph-mon[52364]: osdmap e13: 3 total, 2 up, 3 in 2026-03-09T00:30:57.160 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:56 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:30:58.084 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:57 vm05 ceph-mon[52364]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:30:59.132 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:58 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-03-09T00:30:59.132 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:58 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:30:59.132 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:30:58 vm05 ceph-mon[52364]: Deploying daemon osd.2 on vm05 2026-03-09T00:31:00.231 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:00 vm05 ceph-mon[52364]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:31:01.114 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:01 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:01.114 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:01 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:01.114 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:01 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:01.854 INFO:teuthology.orchestra.run.vm05.stdout:Created osd(s) 2 on host 'vm05' 2026-03-09T00:31:02.017 DEBUG:teuthology.orchestra.run.vm05:osd.2> sudo journalctl -f -n 0 -u ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0@osd.2.service 2026-03-09T00:31:02.018 INFO:tasks.cephadm:Waiting for 3 OSDs to come up... 2026-03-09T00:31:02.018 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph osd stat -f json 2026-03-09T00:31:02.351 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:02.535 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 09 00:31:02 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-osd-2[75762]: 2026-03-09T00:31:02.259+0000 7f63c191a740 -1 osd.2 0 log_to_monitors true 2026-03-09T00:31:02.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:02 vm05 ceph-mon[52364]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:31:02.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:02 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:02.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:02 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:02.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:02 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:02.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:02 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:02.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:02 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:02.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:02 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:02.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:02 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:02.536 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:02 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:02.639 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:31:02.789 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":13,"num_osds":3,"num_up_osds":2,"osd_up_since":1773016253,"num_in_osds":3,"osd_in_since":1773016253,"num_remapped_pgs":0} 2026-03-09T00:31:03.265 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:03 vm05 ceph-mon[52364]: from='osd.2 [v2:192.168.123.105:6818/1126808172,v1:192.168.123.105:6819/1126808172]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]: dispatch 2026-03-09T00:31:03.265 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:03 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/4040714820' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T00:31:03.265 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:03 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:03.265 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:03 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:03.265 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:03 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:03.265 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:03 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:03.265 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:03 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-03-09T00:31:03.265 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:03 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:03.265 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:03 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:03.265 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:03 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:03.790 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph osd stat -f json 2026-03-09T00:31:03.958 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:04.190 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:31:04.338 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:04 vm05 ceph-mon[52364]: Detected new or changed devices on vm05 2026-03-09T00:31:04.338 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:04 vm05 ceph-mon[52364]: Adjusting osd_memory_target on vm05 to 87739k 2026-03-09T00:31:04.338 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:04 vm05 ceph-mon[52364]: Unable to set osd_memory_target on vm05 to 89845486: error parsing value: Value '89845486' is below minimum 939524096 2026-03-09T00:31:04.338 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:04 vm05 ceph-mon[52364]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:31:04.338 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:04 vm05 ceph-mon[52364]: from='osd.2 [v2:192.168.123.105:6818/1126808172,v1:192.168.123.105:6819/1126808172]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]': finished 2026-03-09T00:31:04.338 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:04 vm05 ceph-mon[52364]: osdmap e14: 3 total, 2 up, 3 in 2026-03-09T00:31:04.338 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:04 vm05 ceph-mon[52364]: from='osd.2 [v2:192.168.123.105:6818/1126808172,v1:192.168.123.105:6819/1126808172]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm05", "root=default"]}]: dispatch 2026-03-09T00:31:04.338 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:04 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:31:04.338 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:04 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3665491175' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T00:31:04.338 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 09 00:31:04 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-osd-2[75762]: 2026-03-09T00:31:04.276+0000 7f63be0ae640 -1 osd.2 0 waiting for initial osdmap 2026-03-09T00:31:04.338 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 09 00:31:04 vm05 ceph-e3e5866c-1b4e-11f1-8647-4d81740f07c0-osd-2[75762]: 2026-03-09T00:31:04.282+0000 7f63b96c5640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T00:31:04.365 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":14,"num_osds":3,"num_up_osds":2,"osd_up_since":1773016253,"num_in_osds":3,"osd_in_since":1773016253,"num_remapped_pgs":0} 2026-03-09T00:31:05.366 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph osd stat -f json 2026-03-09T00:31:05.531 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:05.554 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:05 vm05 ceph-mon[52364]: purged_snaps scrub starts 2026-03-09T00:31:05.554 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:05 vm05 ceph-mon[52364]: purged_snaps scrub ok 2026-03-09T00:31:05.554 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:05 vm05 ceph-mon[52364]: from='osd.2 [v2:192.168.123.105:6818/1126808172,v1:192.168.123.105:6819/1126808172]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm05", "root=default"]}]': finished 2026-03-09T00:31:05.554 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:05 vm05 ceph-mon[52364]: osdmap e15: 3 total, 2 up, 3 in 2026-03-09T00:31:05.554 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:05 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:31:05.554 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:05 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:31:05.763 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:31:05.929 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":16,"num_osds":3,"num_up_osds":3,"osd_up_since":1773016265,"num_in_osds":3,"osd_in_since":1773016253,"num_remapped_pgs":0} 2026-03-09T00:31:05.929 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph osd dump --format=json 2026-03-09T00:31:06.097 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:06.344 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:31:06.344 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":17,"fsid":"e3e5866c-1b4e-11f1-8647-4d81740f07c0","created":"2026-03-09T00:29:55.050729+0000","modified":"2026-03-09T00:31:06.277239+0000","last_up_change":"2026-03-09T00:31:05.275519+0000","last_in_change":"2026-03-09T00:30:53.961734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-09T00:31:05.286120+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfb051b5-1988-4463-a1c8-87f9f52d090c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6802","nonce":3300718180},{"type":"v1","addr":"192.168.123.105:6803","nonce":3300718180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6804","nonce":3300718180},{"type":"v1","addr":"192.168.123.105:6805","nonce":3300718180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6808","nonce":3300718180},{"type":"v1","addr":"192.168.123.105:6809","nonce":3300718180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6806","nonce":3300718180},{"type":"v1","addr":"192.168.123.105:6807","nonce":3300718180}]},"public_addr":"192.168.123.105:6803/3300718180","cluster_addr":"192.168.123.105:6805/3300718180","heartbeat_back_addr":"192.168.123.105:6809/3300718180","heartbeat_front_addr":"192.168.123.105:6807/3300718180","state":["exists","up"]},{"osd":1,"uuid":"a9057b8c-a8e2-4ab2-84ca-505384166cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6810","nonce":1566487350},{"type":"v1","addr":"192.168.123.105:6811","nonce":1566487350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6812","nonce":1566487350},{"type":"v1","addr":"192.168.123.105:6813","nonce":1566487350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6816","nonce":1566487350},{"type":"v1","addr":"192.168.123.105:6817","nonce":1566487350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6814","nonce":1566487350},{"type":"v1","addr":"192.168.123.105:6815","nonce":1566487350}]},"public_addr":"192.168.123.105:6811/1566487350","cluster_addr":"192.168.123.105:6813/1566487350","heartbeat_back_addr":"192.168.123.105:6817/1566487350","heartbeat_front_addr":"192.168.123.105:6815/1566487350","state":["exists","up"]},{"osd":2,"uuid":"1e7609c0-3185-4d62-9ed6-455a8c75d0e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6818","nonce":1126808172},{"type":"v1","addr":"192.168.123.105:6819","nonce":1126808172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6820","nonce":1126808172},{"type":"v1","addr":"192.168.123.105:6821","nonce":1126808172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6824","nonce":1126808172},{"type":"v1","addr":"192.168.123.105:6825","nonce":1126808172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6822","nonce":1126808172},{"type":"v1","addr":"192.168.123.105:6823","nonce":1126808172}]},"public_addr":"192.168.123.105:6819/1126808172","cluster_addr":"192.168.123.105:6821/1126808172","heartbeat_back_addr":"192.168.123.105:6825/1126808172","heartbeat_front_addr":"192.168.123.105:6823/1126808172","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:40.743450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:51.916959+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:31:03.233609+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.123.105:6801/1616503384":"2026-03-10T00:30:19.230618+0000","192.168.123.105:0/3888610061":"2026-03-10T00:30:19.230618+0000","192.168.123.105:6801/3360842965":"2026-03-10T00:30:07.719066+0000","192.168.123.105:6800/3360842965":"2026-03-10T00:30:07.719066+0000","192.168.123.105:0/451456932":"2026-03-10T00:30:19.230618+0000","192.168.123.105:0/2869057646":"2026-03-10T00:30:07.719066+0000","192.168.123.105:0/3525212973":"2026-03-10T00:30:19.230618+0000","192.168.123.105:0/1135135590":"2026-03-10T00:30:07.719066+0000","192.168.123.105:6800/1616503384":"2026-03-10T00:30:19.230618+0000","192.168.123.105:0/2894174263":"2026-03-10T00:30:07.719066+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-09T00:31:06.489 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:06 vm05 ceph-mon[52364]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T00:31:06.489 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:06 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:31:06.489 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:06 vm05 ceph-mon[52364]: osd.2 [v2:192.168.123.105:6818/1126808172,v1:192.168.123.105:6819/1126808172] boot 2026-03-09T00:31:06.489 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:06 vm05 ceph-mon[52364]: osdmap e16: 3 total, 3 up, 3 in 2026-03-09T00:31:06.489 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:06 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T00:31:06.489 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:06 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-03-09T00:31:06.489 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:06 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/806449828' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T00:31:06.489 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:06 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-03-09T00:31:06.489 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:06 vm05 ceph-mon[52364]: osdmap e17: 3 total, 3 up, 3 in 2026-03-09T00:31:06.489 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:06 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-03-09T00:31:06.519 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-03-09T00:31:05.286120+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3, 'score_stable': 3, 'optimal_score': 1, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-03-09T00:31:06.519 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph osd pool get .mgr pg_num 2026-03-09T00:31:06.697 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:06.997 INFO:teuthology.orchestra.run.vm05.stdout:pg_num: 1 2026-03-09T00:31:07.145 INFO:tasks.cephadm:Setting up client nodes... 2026-03-09T00:31:07.145 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-03-09T00:31:07.327 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:07.593 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:07 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/918411233' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T00:31:07.594 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:07 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3538515979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-03-09T00:31:07.594 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:07 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-03-09T00:31:07.594 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:07 vm05 ceph-mon[52364]: osdmap e18: 3 total, 3 up, 3 in 2026-03-09T00:31:07.594 INFO:teuthology.orchestra.run.vm05.stdout:[client.0] 2026-03-09T00:31:07.594 INFO:teuthology.orchestra.run.vm05.stdout: key = AQDLFK5plmosIxAAkeMFCOA9IvT9UV7rHzPZPg== 2026-03-09T00:31:07.772 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:31:07.773 DEBUG:teuthology.orchestra.run.vm05:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-03-09T00:31:07.773 DEBUG:teuthology.orchestra.run.vm05:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-03-09T00:31:07.819 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-03-09T00:31:07.819 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-03-09T00:31:07.819 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph mgr dump --format=json 2026-03-09T00:31:07.849 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79500]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vde 2026-03-09T00:31:07.850 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79500]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T00:31:07.850 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T00:31:07.850 INFO:journalctl@ceph.osd.0.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79500]: pam_unix(sudo:session): session closed for user root 2026-03-09T00:31:07.850 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79507]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vdd 2026-03-09T00:31:07.850 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79507]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T00:31:07.850 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T00:31:08.032 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:08.109 INFO:journalctl@ceph.osd.1.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79507]: pam_unix(sudo:session): session closed for user root 2026-03-09T00:31:08.109 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79519]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vdc 2026-03-09T00:31:08.109 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79519]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T00:31:08.109 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T00:31:08.109 INFO:journalctl@ceph.osd.2.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79519]: pam_unix(sudo:session): session closed for user root 2026-03-09T00:31:08.109 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79540]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vda 2026-03-09T00:31:08.109 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79540]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T00:31:08.109 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T00:31:08.109 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:07 vm05 sudo[79540]: pam_unix(sudo:session): session closed for user root 2026-03-09T00:31:08.296 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:31:08.441 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:08 vm05 ceph-mon[52364]: pgmap v31: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:31:08.441 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:08 vm05 ceph-mon[52364]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-03-09T00:31:08.441 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:08 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/526223591' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T00:31:08.441 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:08 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/526223591' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T00:31:08.441 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:08 vm05 ceph-mon[52364]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T00:31:08.441 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:08 vm05 ceph-mon[52364]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T00:31:08.441 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:08 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T00:31:08.467 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":13,"flags":0,"active_gid":14150,"active_name":"a","active_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6800","nonce":4080949362},{"type":"v1","addr":"192.168.123.105:6801","nonce":4080949362}]},"active_addr":"192.168.123.105:6801/4080949362","active_change":"2026-03-09T00:30:19.230750+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://192.168.123.105:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"192.168.123.105:0","nonce":2143158492}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"192.168.123.105:0","nonce":102526948}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"192.168.123.105:0","nonce":97396604}]}]} 2026-03-09T00:31:08.468 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-03-09T00:31:08.468 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-03-09T00:31:08.468 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph osd dump --format=json 2026-03-09T00:31:08.638 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:08.862 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:31:08.862 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":19,"fsid":"e3e5866c-1b4e-11f1-8647-4d81740f07c0","created":"2026-03-09T00:29:55.050729+0000","modified":"2026-03-09T00:31:08.591367+0000","last_up_change":"2026-03-09T00:31:05.275519+0000","last_in_change":"2026-03-09T00:30:53.961734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-09T00:31:05.286120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfb051b5-1988-4463-a1c8-87f9f52d090c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6802","nonce":3300718180},{"type":"v1","addr":"192.168.123.105:6803","nonce":3300718180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6804","nonce":3300718180},{"type":"v1","addr":"192.168.123.105:6805","nonce":3300718180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6808","nonce":3300718180},{"type":"v1","addr":"192.168.123.105:6809","nonce":3300718180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6806","nonce":3300718180},{"type":"v1","addr":"192.168.123.105:6807","nonce":3300718180}]},"public_addr":"192.168.123.105:6803/3300718180","cluster_addr":"192.168.123.105:6805/3300718180","heartbeat_back_addr":"192.168.123.105:6809/3300718180","heartbeat_front_addr":"192.168.123.105:6807/3300718180","state":["exists","up"]},{"osd":1,"uuid":"a9057b8c-a8e2-4ab2-84ca-505384166cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6810","nonce":1566487350},{"type":"v1","addr":"192.168.123.105:6811","nonce":1566487350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6812","nonce":1566487350},{"type":"v1","addr":"192.168.123.105:6813","nonce":1566487350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6816","nonce":1566487350},{"type":"v1","addr":"192.168.123.105:6817","nonce":1566487350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6814","nonce":1566487350},{"type":"v1","addr":"192.168.123.105:6815","nonce":1566487350}]},"public_addr":"192.168.123.105:6811/1566487350","cluster_addr":"192.168.123.105:6813/1566487350","heartbeat_back_addr":"192.168.123.105:6817/1566487350","heartbeat_front_addr":"192.168.123.105:6815/1566487350","state":["exists","up"]},{"osd":2,"uuid":"1e7609c0-3185-4d62-9ed6-455a8c75d0e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6818","nonce":1126808172},{"type":"v1","addr":"192.168.123.105:6819","nonce":1126808172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6820","nonce":1126808172},{"type":"v1","addr":"192.168.123.105:6821","nonce":1126808172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6824","nonce":1126808172},{"type":"v1","addr":"192.168.123.105:6825","nonce":1126808172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6822","nonce":1126808172},{"type":"v1","addr":"192.168.123.105:6823","nonce":1126808172}]},"public_addr":"192.168.123.105:6819/1126808172","cluster_addr":"192.168.123.105:6821/1126808172","heartbeat_back_addr":"192.168.123.105:6825/1126808172","heartbeat_front_addr":"192.168.123.105:6823/1126808172","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:40.743450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:51.916959+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:31:03.233609+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.123.105:6801/1616503384":"2026-03-10T00:30:19.230618+0000","192.168.123.105:0/3888610061":"2026-03-10T00:30:19.230618+0000","192.168.123.105:6801/3360842965":"2026-03-10T00:30:07.719066+0000","192.168.123.105:6800/3360842965":"2026-03-10T00:30:07.719066+0000","192.168.123.105:0/451456932":"2026-03-10T00:30:19.230618+0000","192.168.123.105:0/2869057646":"2026-03-10T00:30:07.719066+0000","192.168.123.105:0/3525212973":"2026-03-10T00:30:19.230618+0000","192.168.123.105:0/1135135590":"2026-03-10T00:30:07.719066+0000","192.168.123.105:6800/1616503384":"2026-03-10T00:30:19.230618+0000","192.168.123.105:0/2894174263":"2026-03-10T00:30:07.719066+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-09T00:31:09.030 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-03-09T00:31:09.030 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph osd dump --format=json 2026-03-09T00:31:09.193 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:09.425 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:31:09.425 INFO:teuthology.orchestra.run.vm05.stdout:{"epoch":19,"fsid":"e3e5866c-1b4e-11f1-8647-4d81740f07c0","created":"2026-03-09T00:29:55.050729+0000","modified":"2026-03-09T00:31:08.591367+0000","last_up_change":"2026-03-09T00:31:05.275519+0000","last_in_change":"2026-03-09T00:30:53.961734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-09T00:31:05.286120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfb051b5-1988-4463-a1c8-87f9f52d090c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6802","nonce":3300718180},{"type":"v1","addr":"192.168.123.105:6803","nonce":3300718180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6804","nonce":3300718180},{"type":"v1","addr":"192.168.123.105:6805","nonce":3300718180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6808","nonce":3300718180},{"type":"v1","addr":"192.168.123.105:6809","nonce":3300718180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6806","nonce":3300718180},{"type":"v1","addr":"192.168.123.105:6807","nonce":3300718180}]},"public_addr":"192.168.123.105:6803/3300718180","cluster_addr":"192.168.123.105:6805/3300718180","heartbeat_back_addr":"192.168.123.105:6809/3300718180","heartbeat_front_addr":"192.168.123.105:6807/3300718180","state":["exists","up"]},{"osd":1,"uuid":"a9057b8c-a8e2-4ab2-84ca-505384166cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6810","nonce":1566487350},{"type":"v1","addr":"192.168.123.105:6811","nonce":1566487350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6812","nonce":1566487350},{"type":"v1","addr":"192.168.123.105:6813","nonce":1566487350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6816","nonce":1566487350},{"type":"v1","addr":"192.168.123.105:6817","nonce":1566487350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6814","nonce":1566487350},{"type":"v1","addr":"192.168.123.105:6815","nonce":1566487350}]},"public_addr":"192.168.123.105:6811/1566487350","cluster_addr":"192.168.123.105:6813/1566487350","heartbeat_back_addr":"192.168.123.105:6817/1566487350","heartbeat_front_addr":"192.168.123.105:6815/1566487350","state":["exists","up"]},{"osd":2,"uuid":"1e7609c0-3185-4d62-9ed6-455a8c75d0e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6818","nonce":1126808172},{"type":"v1","addr":"192.168.123.105:6819","nonce":1126808172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6820","nonce":1126808172},{"type":"v1","addr":"192.168.123.105:6821","nonce":1126808172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6824","nonce":1126808172},{"type":"v1","addr":"192.168.123.105:6825","nonce":1126808172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.105:6822","nonce":1126808172},{"type":"v1","addr":"192.168.123.105:6823","nonce":1126808172}]},"public_addr":"192.168.123.105:6819/1126808172","cluster_addr":"192.168.123.105:6821/1126808172","heartbeat_back_addr":"192.168.123.105:6825/1126808172","heartbeat_front_addr":"192.168.123.105:6823/1126808172","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:40.743450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:30:51.916959+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T00:31:03.233609+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.123.105:6801/1616503384":"2026-03-10T00:30:19.230618+0000","192.168.123.105:0/3888610061":"2026-03-10T00:30:19.230618+0000","192.168.123.105:6801/3360842965":"2026-03-10T00:30:07.719066+0000","192.168.123.105:6800/3360842965":"2026-03-10T00:30:07.719066+0000","192.168.123.105:0/451456932":"2026-03-10T00:30:19.230618+0000","192.168.123.105:0/2869057646":"2026-03-10T00:30:07.719066+0000","192.168.123.105:0/3525212973":"2026-03-10T00:30:19.230618+0000","192.168.123.105:0/1135135590":"2026-03-10T00:30:07.719066+0000","192.168.123.105:6800/1616503384":"2026-03-10T00:30:19.230618+0000","192.168.123.105:0/2894174263":"2026-03-10T00:30:07.719066+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-09T00:31:09.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:09 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/2088334293' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-03-09T00:31:09.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:09 vm05 ceph-mon[52364]: osdmap e19: 3 total, 3 up, 3 in 2026-03-09T00:31:09.535 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:09 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/2241425020' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T00:31:09.596 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph tell osd.0 flush_pg_stats 2026-03-09T00:31:09.596 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph tell osd.1 flush_pg_stats 2026-03-09T00:31:09.596 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph tell osd.2 flush_pg_stats 2026-03-09T00:31:09.822 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:09.935 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:09.984 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:10.199 INFO:teuthology.orchestra.run.vm05.stdout:68719476738 2026-03-09T00:31:10.199 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph osd last-stat-seq osd.2 2026-03-09T00:31:10.326 INFO:teuthology.orchestra.run.vm05.stdout:34359738375 2026-03-09T00:31:10.326 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph osd last-stat-seq osd.0 2026-03-09T00:31:10.342 INFO:teuthology.orchestra.run.vm05.stdout:51539607557 2026-03-09T00:31:10.342 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph osd last-stat-seq osd.1 2026-03-09T00:31:10.423 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:10.425 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:10 vm05 ceph-mon[52364]: pgmap v34: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:31:10.425 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:10 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/876297045' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T00:31:10.425 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:10 vm05 ceph-mon[52364]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-03-09T00:31:10.425 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:10 vm05 ceph-mon[52364]: Cluster is now healthy 2026-03-09T00:31:10.425 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:10 vm05 ceph-mon[52364]: mgrmap e14: a(active, since 50s) 2026-03-09T00:31:10.642 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:10.667 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:10.762 INFO:teuthology.orchestra.run.vm05.stdout:68719476737 2026-03-09T00:31:10.928 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476738 got 68719476737 for osd.2 2026-03-09T00:31:10.980 INFO:teuthology.orchestra.run.vm05.stdout:51539607555 2026-03-09T00:31:11.028 INFO:teuthology.orchestra.run.vm05.stdout:34359738374 2026-03-09T00:31:11.132 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607557 got 51539607555 for osd.1 2026-03-09T00:31:11.197 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.0 2026-03-09T00:31:11.784 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:11 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/299438336' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-03-09T00:31:11.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:11 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3648276630' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-03-09T00:31:11.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:11 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3883710588' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-03-09T00:31:11.929 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph osd last-stat-seq osd.2 2026-03-09T00:31:12.093 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:12.132 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph osd last-stat-seq osd.1 2026-03-09T00:31:12.197 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph osd last-stat-seq osd.0 2026-03-09T00:31:12.338 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:12.353 INFO:teuthology.orchestra.run.vm05.stdout:68719476738 2026-03-09T00:31:12.464 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:12 vm05 ceph-mon[52364]: pgmap v35: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:31:12.547 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476738 got 68719476738 for osd.2 2026-03-09T00:31:12.547 DEBUG:teuthology.parallel:result is None 2026-03-09T00:31:12.567 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:12.649 INFO:teuthology.orchestra.run.vm05.stdout:51539607557 2026-03-09T00:31:12.808 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607557 got 51539607557 for osd.1 2026-03-09T00:31:12.808 DEBUG:teuthology.parallel:result is None 2026-03-09T00:31:12.812 INFO:teuthology.orchestra.run.vm05.stdout:34359738375 2026-03-09T00:31:12.967 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.0 2026-03-09T00:31:12.967 DEBUG:teuthology.parallel:result is None 2026-03-09T00:31:12.967 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-03-09T00:31:12.967 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph pg dump --format=json 2026-03-09T00:31:13.168 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:13.389 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:13 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3534558110' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-03-09T00:31:13.389 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:13 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3090514085' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-03-09T00:31:13.389 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:13 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3938036398' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-03-09T00:31:13.389 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:31:13.390 INFO:teuthology.orchestra.run.vm05.stderr:dumped all 2026-03-09T00:31:13.537 INFO:teuthology.orchestra.run.vm05.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2026-03-09T00:31:13.245955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":62902272,"kb_used":82740,"kb_used_data":1828,"kb_used_omap":4,"kb_used_meta":80443,"kb_avail":62819532,"statfs":{"total":64411926528,"available":64327200768,"internally_reserved":0,"allocated":1871872,"data_stored":1519202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4769,"internal_metadata":82373983},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000298"},"pg_stats":[{"pgid":"1.0","version":"18'32","reported_seq":57,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-03-09T00:31:08.594213+0000","last_change":"2026-03-09T00:31:07.738441+0000","last_active":"2026-03-09T00:31:08.594213+0000","last_peered":"2026-03-09T00:31:08.594213+0000","last_clean":"2026-03-09T00:31:08.594213+0000","last_became_active":"2026-03-09T00:31:07.738304+0000","last_became_peered":"2026-03-09T00:31:07.738304+0000","last_unstale":"2026-03-09T00:31:08.594213+0000","last_undegraded":"2026-03-09T00:31:08.594213+0000","last_fullsized":"2026-03-09T00:31:08.594213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:06.277239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:06.277239+0000","last_clean_scrub_stamp":"2026-03-09T00:31:06.277239+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:59:15.184342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1388544,"data_stored":1377840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476739,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27588,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939836,"statfs":{"total":21470642176,"available":21442392064,"internally_reserved":0,"allocated":626688,"data_stored":507593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607557,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27584,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939840,"statfs":{"total":21470642176,"available":21442396160,"internally_reserved":0,"allocated":626688,"data_stored":507593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27568,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939856,"statfs":{"total":21470642176,"available":21442412544,"internally_reserved":0,"allocated":618496,"data_stored":504016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27457995},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-09T00:31:13.537 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph pg dump --format=json 2026-03-09T00:31:13.701 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:13.913 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:31:13.913 INFO:teuthology.orchestra.run.vm05.stderr:dumped all 2026-03-09T00:31:14.083 INFO:teuthology.orchestra.run.vm05.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2026-03-09T00:31:13.245955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":62902272,"kb_used":82740,"kb_used_data":1828,"kb_used_omap":4,"kb_used_meta":80443,"kb_avail":62819532,"statfs":{"total":64411926528,"available":64327200768,"internally_reserved":0,"allocated":1871872,"data_stored":1519202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4769,"internal_metadata":82373983},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000298"},"pg_stats":[{"pgid":"1.0","version":"18'32","reported_seq":57,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-03-09T00:31:08.594213+0000","last_change":"2026-03-09T00:31:07.738441+0000","last_active":"2026-03-09T00:31:08.594213+0000","last_peered":"2026-03-09T00:31:08.594213+0000","last_clean":"2026-03-09T00:31:08.594213+0000","last_became_active":"2026-03-09T00:31:07.738304+0000","last_became_peered":"2026-03-09T00:31:07.738304+0000","last_unstale":"2026-03-09T00:31:08.594213+0000","last_undegraded":"2026-03-09T00:31:08.594213+0000","last_fullsized":"2026-03-09T00:31:08.594213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T00:31:06.277239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T00:31:06.277239+0000","last_clean_scrub_stamp":"2026-03-09T00:31:06.277239+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T01:59:15.184342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1388544,"data_stored":1377840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476739,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27588,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939836,"statfs":{"total":21470642176,"available":21442392064,"internally_reserved":0,"allocated":626688,"data_stored":507593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607557,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27584,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939840,"statfs":{"total":21470642176,"available":21442396160,"internally_reserved":0,"allocated":626688,"data_stored":507593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27568,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939856,"statfs":{"total":21470642176,"available":21442412544,"internally_reserved":0,"allocated":618496,"data_stored":504016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27457995},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-09T00:31:14.083 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-03-09T00:31:14.083 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-03-09T00:31:14.084 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-03-09T00:31:14.084 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- ceph health --format=json 2026-03-09T00:31:14.248 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:14.314 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:14 vm05 ceph-mon[52364]: pgmap v36: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:31:14.314 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:14 vm05 ceph-mon[52364]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T00:31:14.482 INFO:teuthology.orchestra.run.vm05.stdout: 2026-03-09T00:31:14.482 INFO:teuthology.orchestra.run.vm05.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-03-09T00:31:14.629 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-03-09T00:31:14.629 INFO:tasks.cephadm:Setup complete, yielding 2026-03-09T00:31:14.629 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-03-09T00:31:14.631 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@vm05.local 2026-03-09T00:31:14.631 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- bash -c 'ceph osd pool create foo' 2026-03-09T00:31:14.796 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:15.317 INFO:teuthology.orchestra.run.vm05.stderr:pool 'foo' created 2026-03-09T00:31:15.493 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- bash -c 'rbd pool init foo' 2026-03-09T00:31:15.659 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:15.685 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:15 vm05 ceph-mon[52364]: from='client.14252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T00:31:15.685 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:15 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1521891818' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-03-09T00:31:15.685 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:15 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1723231708' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2026-03-09T00:31:16.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:16 vm05 ceph-mon[52364]: pgmap v37: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:31:16.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:16 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1723231708' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2026-03-09T00:31:16.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:16 vm05 ceph-mon[52364]: osdmap e20: 3 total, 3 up, 3 in 2026-03-09T00:31:16.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:16 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3516875809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2026-03-09T00:31:16.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:16 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3516875809' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2026-03-09T00:31:16.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:16 vm05 ceph-mon[52364]: osdmap e21: 3 total, 3 up, 3 in 2026-03-09T00:31:18.491 DEBUG:teuthology.orchestra.run.vm05:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3e5866c-1b4e-11f1-8647-4d81740f07c0 -- bash -c 'ceph orch apply iscsi foo u p' 2026-03-09T00:31:18.641 INFO:teuthology.orchestra.run.vm05.stderr:Inferring config /var/lib/ceph/e3e5866c-1b4e-11f1-8647-4d81740f07c0/mon.a/config 2026-03-09T00:31:18.662 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:18 vm05 ceph-mon[52364]: pgmap v40: 33 pgs: 9 creating+peering, 23 unknown, 1 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:31:18.662 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:18 vm05 ceph-mon[52364]: osdmap e22: 3 total, 3 up, 3 in 2026-03-09T00:31:18.862 INFO:teuthology.orchestra.run.vm05.stdout:Scheduled iscsi.foo update... 2026-03-09T00:31:19.020 INFO:teuthology.run_tasks:Running task workunit... 2026-03-09T00:31:19.023 INFO:tasks.workunit:Pulling workunits from ref 569c3e99c9b32a51b4eaf08731c728f4513ed589 2026-03-09T00:31:19.023 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-03-09T00:31:19.023 DEBUG:teuthology.orchestra.run.vm05:> stat -- /home/ubuntu/cephtest/mnt.0 2026-03-09T00:31:19.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T00:31:19.058 INFO:teuthology.orchestra.run.vm05.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-03-09T00:31:19.058 DEBUG:teuthology.orchestra.run.vm05:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-03-09T00:31:19.127 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-03-09T00:31:19.127 DEBUG:teuthology.orchestra.run.vm05:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-03-09T00:31:19.180 INFO:tasks.workunit:timeout=3h 2026-03-09T00:31:19.180 INFO:tasks.workunit:cleanup=True 2026-03-09T00:31:19.180 DEBUG:teuthology.orchestra.run.vm05:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/kshtsk/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 569c3e99c9b32a51b4eaf08731c728f4513ed589 2026-03-09T00:31:19.234 INFO:tasks.workunit.client.0.vm05.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-03-09T00:31:19.533 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:19 vm05 ceph-mon[52364]: osdmap e23: 3 total, 3 up, 3 in 2026-03-09T00:31:19.533 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:19 vm05 ceph-mon[52364]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T00:31:19.534 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:19 vm05 ceph-mon[52364]: Saving service iscsi.foo spec with placement count:1 2026-03-09T00:31:19.534 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:19.534 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:19.534 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:19.534 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:19.534 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:19.534 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.vm05.uvvtsq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2026-03-09T00:31:19.534 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.vm05.uvvtsq", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2026-03-09T00:31:19.534 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:19 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:19.534 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:19 vm05 ceph-mon[52364]: Deploying daemon iscsi.foo.vm05.uvvtsq on vm05 2026-03-09T00:31:21.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:20 vm05 ceph-mon[52364]: pgmap v43: 33 pgs: 9 creating+peering, 11 unknown, 13 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:31:21.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:20 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:21.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:20 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:21.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:20 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:21.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:20 vm05 ceph-mon[52364]: Checking pool "foo" exists for service iscsi.foo 2026-03-09T00:31:21.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:20 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:21.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:20 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:21.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:20 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3072050251' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-03-09T00:31:21.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:20 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/226113638' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:6801/1616503384"}]: dispatch 2026-03-09T00:31:21.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:20 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:21.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:20 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:22.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: Adding iSCSI gateway http://:@192.168.123.105:5000 to Dashboard 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "vm05"}]: dispatch 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "vm05"}]: dispatch 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/226113638' entity='client.iscsi.foo.vm05.uvvtsq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:6801/1616503384"}]': finished 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: osdmap e24: 3 total, 3 up, 3 in 2026-03-09T00:31:22.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:21 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/2522165962' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:0/3888610061"}]: dispatch 2026-03-09T00:31:23.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:22 vm05 ceph-mon[52364]: pgmap v45: 33 pgs: 9 creating+peering, 24 active+clean; 449 KiB data, 80 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:31:23.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:22 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/2522165962' entity='client.iscsi.foo.vm05.uvvtsq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:0/3888610061"}]': finished 2026-03-09T00:31:23.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:22 vm05 ceph-mon[52364]: osdmap e25: 3 total, 3 up, 3 in 2026-03-09T00:31:23.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:22 vm05 ceph-mon[52364]: mgrmap e15: a(active, since 62s) 2026-03-09T00:31:23.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:22 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/158473229' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:6801/3360842965"}]: dispatch 2026-03-09T00:31:24.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:23 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/158473229' entity='client.iscsi.foo.vm05.uvvtsq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:6801/3360842965"}]': finished 2026-03-09T00:31:24.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:23 vm05 ceph-mon[52364]: osdmap e26: 3 total, 3 up, 3 in 2026-03-09T00:31:24.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:23 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1846311400' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:6800/3360842965"}]: dispatch 2026-03-09T00:31:24.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:23 vm05 ceph-mon[52364]: pgmap v48: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 417 B/s rd, 626 B/s wr, 2 op/s 2026-03-09T00:31:25.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:24 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1846311400' entity='client.iscsi.foo.vm05.uvvtsq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:6800/3360842965"}]': finished 2026-03-09T00:31:25.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:24 vm05 ceph-mon[52364]: osdmap e27: 3 total, 3 up, 3 in 2026-03-09T00:31:25.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:24 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3831634633' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:0/451456932"}]: dispatch 2026-03-09T00:31:25.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:24 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:26.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:25 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3831634633' entity='client.iscsi.foo.vm05.uvvtsq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:0/451456932"}]': finished 2026-03-09T00:31:26.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:25 vm05 ceph-mon[52364]: osdmap e28: 3 total, 3 up, 3 in 2026-03-09T00:31:26.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:25 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/130846136' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:0/2869057646"}]: dispatch 2026-03-09T00:31:26.285 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:25 vm05 ceph-mon[52364]: pgmap v51: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 511 B/s rd, 767 B/s wr, 3 op/s 2026-03-09T00:31:26.980 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:26 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/130846136' entity='client.iscsi.foo.vm05.uvvtsq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:0/2869057646"}]': finished 2026-03-09T00:31:26.980 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:26 vm05 ceph-mon[52364]: osdmap e29: 3 total, 3 up, 3 in 2026-03-09T00:31:26.980 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:26 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1437795747' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:0/3525212973"}]: dispatch 2026-03-09T00:31:26.980 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:26 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1437795747' entity='client.iscsi.foo.vm05.uvvtsq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:0/3525212973"}]': finished 2026-03-09T00:31:26.980 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:26 vm05 ceph-mon[52364]: osdmap e30: 3 total, 3 up, 3 in 2026-03-09T00:31:26.980 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:26 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1955633256' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:0/1135135590"}]: dispatch 2026-03-09T00:31:29.034 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:28 vm05 ceph-mon[52364]: pgmap v54: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:31:29.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:28 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/1955633256' entity='client.iscsi.foo.vm05.uvvtsq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:0/1135135590"}]': finished 2026-03-09T00:31:29.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:28 vm05 ceph-mon[52364]: osdmap e31: 3 total, 3 up, 3 in 2026-03-09T00:31:29.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:28 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/2067552033' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:6800/1616503384"}]: dispatch 2026-03-09T00:31:30.034 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:29 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/2067552033' entity='client.iscsi.foo.vm05.uvvtsq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:6800/1616503384"}]': finished 2026-03-09T00:31:30.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:29 vm05 ceph-mon[52364]: osdmap e32: 3 total, 3 up, 3 in 2026-03-09T00:31:30.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:29 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3133781820' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:0/2894174263"}]: dispatch 2026-03-09T00:31:30.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:29 vm05 ceph-mon[52364]: from='mgr.14150 192.168.123.105:0/3154408944' entity='mgr.a' 2026-03-09T00:31:31.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:30 vm05 ceph-mon[52364]: pgmap v57: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:31:31.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:30 vm05 ceph-mon[52364]: from='client.? 192.168.123.105:0/3133781820' entity='client.iscsi.foo.vm05.uvvtsq' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "192.168.123.105:0/2894174263"}]': finished 2026-03-09T00:31:31.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:30 vm05 ceph-mon[52364]: osdmap e33: 3 total, 3 up, 3 in 2026-03-09T00:31:32.034 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:31 vm05 ceph-mon[52364]: from='client.14267 -' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T00:31:33.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:32 vm05 ceph-mon[52364]: pgmap v59: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T00:31:35.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:34 vm05 ceph-mon[52364]: pgmap v60: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:31:37.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:36 vm05 ceph-mon[52364]: pgmap v61: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 666 B/s rd, 0 op/s 2026-03-09T00:31:39.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:38 vm05 ceph-mon[52364]: pgmap v62: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:31:41.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:40 vm05 ceph-mon[52364]: pgmap v63: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 1023 B/s rd, 0 op/s 2026-03-09T00:31:42.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:41 vm05 ceph-mon[52364]: from='client.14267 -' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T00:31:43.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:42 vm05 ceph-mon[52364]: pgmap v64: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 877 B/s rd, 0 op/s 2026-03-09T00:31:45.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:44 vm05 ceph-mon[52364]: pgmap v65: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:31:47.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:46 vm05 ceph-mon[52364]: pgmap v66: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:31:49.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:48 vm05 ceph-mon[52364]: pgmap v67: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:31:51.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:50 vm05 ceph-mon[52364]: pgmap v68: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:31:52.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:51 vm05 ceph-mon[52364]: from='client.14267 -' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T00:31:53.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:52 vm05 ceph-mon[52364]: pgmap v69: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:31:54.284 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:54 vm05 ceph-mon[52364]: pgmap v70: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:31:56.784 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:56 vm05 ceph-mon[52364]: pgmap v71: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:31:58.784 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:31:58 vm05 ceph-mon[52364]: pgmap v72: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:32:00.418 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:32:00 vm05 ceph-mon[52364]: pgmap v73: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr:Note: switching to '569c3e99c9b32a51b4eaf08731c728f4513ed589'. 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr: 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr:changes and commit them, and you can discard any commits you make in this 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr:state without impacting any branches by switching back to a branch. 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr: 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr:If you want to create a new branch to retain commits you create, you may 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr:do so (now or later) by using -c with the switch command. Example: 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr: 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr: git switch -c 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr: 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr:Or undo this operation with: 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr: 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr: git switch - 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr: 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr: 2026-03-09T00:32:00.854 INFO:tasks.workunit.client.0.vm05.stderr:HEAD is now at 569c3e99c9b qa/rgw: bucket notifications use pynose 2026-03-09T00:32:00.859 DEBUG:teuthology.orchestra.run.vm05:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-03-09T00:32:00.913 INFO:tasks.workunit.client.0.vm05.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-03-09T00:32:00.915 INFO:tasks.workunit.client.0.vm05.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-03-09T00:32:00.915 INFO:tasks.workunit.client.0.vm05.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-03-09T00:32:00.956 INFO:tasks.workunit.client.0.vm05.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-03-09T00:32:00.989 INFO:tasks.workunit.client.0.vm05.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-03-09T00:32:01.017 INFO:tasks.workunit.client.0.vm05.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-03-09T00:32:01.018 INFO:tasks.workunit.client.0.vm05.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-03-09T00:32:01.018 INFO:tasks.workunit.client.0.vm05.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-03-09T00:32:01.046 INFO:tasks.workunit.client.0.vm05.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-03-09T00:32:01.049 DEBUG:teuthology.orchestra.run.vm05:> set -ex 2026-03-09T00:32:01.049 DEBUG:teuthology.orchestra.run.vm05:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-03-09T00:32:01.104 INFO:tasks.workunit:Running workunits matching cephadm/test_iscsi_pids_limit.sh on client.0... 2026-03-09T00:32:01.105 INFO:tasks.workunit:Running workunit cephadm/test_iscsi_pids_limit.sh... 2026-03-09T00:32:01.105 DEBUG:teuthology.orchestra.run.vm05:workunit test cephadm/test_iscsi_pids_limit.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=569c3e99c9b32a51b4eaf08731c728f4513ed589 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_iscsi_pids_limit.sh 2026-03-09T00:32:01.164 INFO:tasks.workunit.client.0.vm05.stderr:++ sudo podman ps -qa --filter=name=iscsi 2026-03-09T00:32:01.194 INFO:tasks.workunit.client.0.vm05.stderr:+ ISCSI_CONT_IDS='cb94ba5198f3 2026-03-09T00:32:01.194 INFO:tasks.workunit.client.0.vm05.stderr:b08ba5888e83' 2026-03-09T00:32:01.194 INFO:tasks.workunit.client.0.vm05.stderr:++ echo cb94ba5198f3 b08ba5888e83 2026-03-09T00:32:01.194 INFO:tasks.workunit.client.0.vm05.stderr:++ wc -w 2026-03-09T00:32:01.196 INFO:tasks.workunit.client.0.vm05.stderr:+ CONT_COUNT=2 2026-03-09T00:32:01.196 INFO:tasks.workunit.client.0.vm05.stderr:+ test 2 -eq 2 2026-03-09T00:32:01.196 INFO:tasks.workunit.client.0.vm05.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-03-09T00:32:01.196 INFO:tasks.workunit.client.0.vm05.stderr:++ sudo podman exec cb94ba5198f3 cat /sys/fs/cgroup/pids/pids.max 2026-03-09T00:32:01.248 INFO:tasks.workunit.client.0.vm05.stderr:cat: /sys/fs/cgroup/pids/pids.max: No such file or directory 2026-03-09T00:32:01.300 INFO:tasks.workunit.client.0.vm05.stderr:+ '[' ']' 2026-03-09T00:32:01.300 INFO:tasks.workunit.client.0.vm05.stderr:++ sudo podman exec cb94ba5198f3 cat /sys/fs/cgroup/pids.max 2026-03-09T00:32:01.390 INFO:tasks.workunit.client.0.vm05.stderr:+ '[' max ']' 2026-03-09T00:32:01.390 INFO:tasks.workunit.client.0.vm05.stderr:++ sudo podman exec cb94ba5198f3 cat /sys/fs/cgroup/pids.max 2026-03-09T00:32:01.435 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:32:01 vm05 ceph-mon[52364]: from='client.14267 -' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T00:32:01.489 INFO:tasks.workunit.client.0.vm05.stderr:+ pid_limit=max 2026-03-09T00:32:01.490 INFO:tasks.workunit.client.0.vm05.stderr:+ test max == max 2026-03-09T00:32:01.490 INFO:tasks.workunit.client.0.vm05.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-03-09T00:32:01.490 INFO:tasks.workunit.client.0.vm05.stderr:++ sudo podman exec b08ba5888e83 cat /sys/fs/cgroup/pids/pids.max 2026-03-09T00:32:01.529 INFO:tasks.workunit.client.0.vm05.stderr:cat: /sys/fs/cgroup/pids/pids.max: No such file or directory 2026-03-09T00:32:01.583 INFO:tasks.workunit.client.0.vm05.stderr:+ '[' ']' 2026-03-09T00:32:01.583 INFO:tasks.workunit.client.0.vm05.stderr:++ sudo podman exec b08ba5888e83 cat /sys/fs/cgroup/pids.max 2026-03-09T00:32:01.676 INFO:tasks.workunit.client.0.vm05.stderr:+ '[' max ']' 2026-03-09T00:32:01.676 INFO:tasks.workunit.client.0.vm05.stderr:++ sudo podman exec b08ba5888e83 cat /sys/fs/cgroup/pids.max 2026-03-09T00:32:01.771 INFO:tasks.workunit.client.0.vm05.stderr:+ pid_limit=max 2026-03-09T00:32:01.771 INFO:tasks.workunit.client.0.vm05.stderr:+ test max == max 2026-03-09T00:32:01.771 INFO:tasks.workunit.client.0.vm05.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-03-09T00:32:01.771 INFO:tasks.workunit.client.0.vm05.stderr:+ sudo podman exec cb94ba5198f3 /bin/sh -c 'for j in {0..20000}; do sleep 300 & done' 2026-03-09T00:32:02.784 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:32:02 vm05 ceph-mon[52364]: pgmap v74: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:04.784 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:32:04 vm05 ceph-mon[52364]: pgmap v75: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:32:06.784 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:32:06 vm05 ceph-mon[52364]: pgmap v76: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:08.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:32:08 vm05 ceph-mon[52364]: pgmap v77: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:32:10.785 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:32:10 vm05 ceph-mon[52364]: pgmap v78: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:12.035 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:32:11 vm05 ceph-mon[52364]: from='client.14267 -' entity='client.iscsi.foo.vm05.uvvtsq' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T00:32:12.430 INFO:tasks.workunit.client.0.vm05.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-03-09T00:32:12.430 INFO:tasks.workunit.client.0.vm05.stderr:+ sudo podman exec b08ba5888e83 /bin/sh -c 'for j in {0..20000}; do sleep 300 & done' 2026-03-09T00:32:13.034 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:32:12 vm05 ceph-mon[52364]: pgmap v79: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 853 B/s rd, 0 op/s 2026-03-09T00:32:15.045 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:32:14 vm05 ceph-mon[52364]: pgmap v80: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 1.2 KiB/s rd, 1 op/s 2026-03-09T00:32:19.983 INFO:journalctl@ceph.mon.a.vm05.stdout:Mar 09 00:32:18 vm05 ceph-mon[52364]: pgmap v81: 33 pgs: 33 active+clean; 449 KiB data, 81 MiB used, 60 GiB / 60 GiB avail; 851 B/s rd, 0 op/s 2026-03-09T00:32:22.383 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2026-03-09T00:32:22.383 DEBUG:teuthology.exit:Finished running handlers