2026-03-09T18:17:51.492 INFO:root:teuthology version: 1.2.4.dev6+g1c580df7a 2026-03-09T18:17:51.496 DEBUG:teuthology.report:Pushing job info to http://localhost:8080 2026-03-09T18:17:51.522 INFO:teuthology.run:Config: archive_path: /archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/603 branch: squid description: orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} email: null first_in_suite: false flavor: default job_id: '603' last_in_suite: false machine_type: vps name: kyr-2026-03-09_11:23:05-orch-squid-none-default-vps no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ansible.cephlab: branch: main skip_tags: nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs vars: timezone: UTC ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: true mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd mclock iops capacity threshold hdd: 49000 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - MON_DOWN - mons down - mon down - out of quorum - CEPHADM_STRAY_DAEMON - CEPHADM_FAILED_DAEMON - CEPHADM_AGENT_DOWN - PG_DEGRADED log-only-match: - CEPHADM_ sha1: e911bdebe5c8faa3800735d1568fcdca65db60df ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: e911bdebe5c8faa3800735d1568fcdca65db60df extra_system_packages: deb: - python3-xmltodict - python3-jmespath rpm: - bzip2 - perl-Test-Harness - python3-xmltodict - python3-jmespath selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: tt-squid sha1: 569c3e99c9b32a51b4eaf08731c728f4513ed589 owner: kyr priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 3443 sha1: e911bdebe5c8faa3800735d1568fcdca65db60df sleep_before_teardown: 0 subset: 1/64 suite: orch suite_branch: tt-squid suite_path: /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa suite_relpath: qa suite_repo: https://github.com/kshtsk/ceph.git suite_sha1: 569c3e99c9b32a51b4eaf08731c728f4513ed589 targets: vm02.local: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMk3NIdIOXQMzw6X2lgXer/Ft2WsWNh99p12E4At2Fpax/QQGHBzyQiZp1efaad2Q+HYj/mQfh+MwmJ7Fncf6YI= vm03.local: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMpPVhhEEl/G75EDevZqu9PfbIcXg2AcaLQ5RCXQiPWMzf8RUofMq/e+W5mjkX5sreAVINrFwLgC1NxgplFixTI= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install runc nvmetcli nvme-cli -y - sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf - sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf - nvme_loop: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - cephadm.shell: mon.a: - stat -c '%u %g' /var/log/ceph | grep '167 167' - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - ceph orch ls --format yaml - ceph orch ls | grep '^osd ' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: clyso-debian-13 teuthology_repo: https://github.com/clyso/teuthology teuthology_sha1: 1c580df7a9c7c2aadc272da296344fd99f27c444 timestamp: 2026-03-09_11:23:05 tube: vps user: kyr verbose: false worker_log: /home/teuthos/.teuthology/dispatcher/dispatcher.vps.611473 2026-03-09T18:17:51.522 INFO:teuthology.run:suite_path is set to /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa; will attempt to use it 2026-03-09T18:17:51.523 INFO:teuthology.run:Found tasks at /home/teuthos/src/github.com_kshtsk_ceph_569c3e99c9b32a51b4eaf08731c728f4513ed589/qa/tasks 2026-03-09T18:17:51.523 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-03-09T18:17:51.523 INFO:teuthology.task.internal:Checking packages... 2026-03-09T18:17:51.523 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e911bdebe5c8faa3800735d1568fcdca65db60df' 2026-03-09T18:17:51.523 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-03-09T18:17:51.523 INFO:teuthology.packaging:ref: None 2026-03-09T18:17:51.523 INFO:teuthology.packaging:tag: None 2026-03-09T18:17:51.523 INFO:teuthology.packaging:branch: squid 2026-03-09T18:17:51.523 INFO:teuthology.packaging:sha1: e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T18:17:51.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2026-03-09T18:17:52.288 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-678.ge911bdeb 2026-03-09T18:17:52.289 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-03-09T18:17:52.290 INFO:teuthology.task.internal:no buildpackages task found 2026-03-09T18:17:52.290 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-03-09T18:17:52.290 INFO:teuthology.task.internal:Saving configuration 2026-03-09T18:17:52.296 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-03-09T18:17:52.296 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-03-09T18:17:52.303 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'vm02.local', 'description': '/archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/603', 'up': True, 'machine_type': 'vps', 'is_vm': True, 'vm_host': {'name': 'localhost', 'description': None, 'up': True, 'machine_type': 'libvirt', 'is_vm': False, 'vm_host': None, 'os_type': None, 'os_version': None, 'arch': None, 'locked': True, 'locked_since': None, 'locked_by': None, 'mac_address': None, 'ssh_pub_key': None}, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-03-09 18:16:25.608479', 'locked_by': 'kyr', 'mac_address': '52:55:00:00:00:02', 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMk3NIdIOXQMzw6X2lgXer/Ft2WsWNh99p12E4At2Fpax/QQGHBzyQiZp1efaad2Q+HYj/mQfh+MwmJ7Fncf6YI='} 2026-03-09T18:17:52.308 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'vm03.local', 'description': '/archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/603', 'up': True, 'machine_type': 'vps', 'is_vm': True, 'vm_host': {'name': 'localhost', 'description': None, 'up': True, 'machine_type': 'libvirt', 'is_vm': False, 'vm_host': None, 'os_type': None, 'os_version': None, 'arch': None, 'locked': True, 'locked_since': None, 'locked_by': None, 'mac_address': None, 'ssh_pub_key': None}, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-03-09 18:16:25.609267', 'locked_by': 'kyr', 'mac_address': '52:55:00:00:00:03', 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMpPVhhEEl/G75EDevZqu9PfbIcXg2AcaLQ5RCXQiPWMzf8RUofMq/e+W5mjkX5sreAVINrFwLgC1NxgplFixTI='} 2026-03-09T18:17:52.308 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-03-09T18:17:52.308 INFO:teuthology.task.internal:roles: ubuntu@vm02.local - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2026-03-09T18:17:52.309 INFO:teuthology.task.internal:roles: ubuntu@vm03.local - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2026-03-09T18:17:52.309 INFO:teuthology.run_tasks:Running task console_log... 2026-03-09T18:17:52.315 DEBUG:teuthology.task.console_log:vm02 does not support IPMI; excluding 2026-03-09T18:17:52.322 DEBUG:teuthology.task.console_log:vm03 does not support IPMI; excluding 2026-03-09T18:17:52.322 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8d5487a170>, signals=[15]) 2026-03-09T18:17:52.322 INFO:teuthology.run_tasks:Running task internal.connect... 2026-03-09T18:17:52.323 INFO:teuthology.task.internal:Opening connections... 2026-03-09T18:17:52.323 DEBUG:teuthology.task.internal:connecting to ubuntu@vm02.local 2026-03-09T18:17:52.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm02.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-09T18:17:52.384 DEBUG:teuthology.task.internal:connecting to ubuntu@vm03.local 2026-03-09T18:17:52.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm03.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-09T18:17:52.449 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-03-09T18:17:52.450 DEBUG:teuthology.orchestra.run.vm02:> uname -m 2026-03-09T18:17:52.496 INFO:teuthology.orchestra.run.vm02.stdout:x86_64 2026-03-09T18:17:52.496 DEBUG:teuthology.orchestra.run.vm02:> cat /etc/os-release 2026-03-09T18:17:52.553 INFO:teuthology.orchestra.run.vm02.stdout:NAME="CentOS Stream" 2026-03-09T18:17:52.553 INFO:teuthology.orchestra.run.vm02.stdout:VERSION="9" 2026-03-09T18:17:52.553 INFO:teuthology.orchestra.run.vm02.stdout:ID="centos" 2026-03-09T18:17:52.553 INFO:teuthology.orchestra.run.vm02.stdout:ID_LIKE="rhel fedora" 2026-03-09T18:17:52.553 INFO:teuthology.orchestra.run.vm02.stdout:VERSION_ID="9" 2026-03-09T18:17:52.553 INFO:teuthology.orchestra.run.vm02.stdout:PLATFORM_ID="platform:el9" 2026-03-09T18:17:52.553 INFO:teuthology.orchestra.run.vm02.stdout:PRETTY_NAME="CentOS Stream 9" 2026-03-09T18:17:52.553 INFO:teuthology.orchestra.run.vm02.stdout:ANSI_COLOR="0;31" 2026-03-09T18:17:52.553 INFO:teuthology.orchestra.run.vm02.stdout:LOGO="fedora-logo-icon" 2026-03-09T18:17:52.553 INFO:teuthology.orchestra.run.vm02.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-03-09T18:17:52.553 INFO:teuthology.orchestra.run.vm02.stdout:HOME_URL="https://centos.org/" 2026-03-09T18:17:52.553 INFO:teuthology.orchestra.run.vm02.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-03-09T18:17:52.553 INFO:teuthology.orchestra.run.vm02.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-03-09T18:17:52.553 INFO:teuthology.orchestra.run.vm02.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-03-09T18:17:52.553 INFO:teuthology.lock.ops:Updating vm02.local on lock server 2026-03-09T18:17:52.558 DEBUG:teuthology.orchestra.run.vm03:> uname -m 2026-03-09T18:17:52.574 INFO:teuthology.orchestra.run.vm03.stdout:x86_64 2026-03-09T18:17:52.584 DEBUG:teuthology.orchestra.run.vm03:> cat /etc/os-release 2026-03-09T18:17:52.630 INFO:teuthology.orchestra.run.vm03.stdout:NAME="CentOS Stream" 2026-03-09T18:17:52.630 INFO:teuthology.orchestra.run.vm03.stdout:VERSION="9" 2026-03-09T18:17:52.630 INFO:teuthology.orchestra.run.vm03.stdout:ID="centos" 2026-03-09T18:17:52.630 INFO:teuthology.orchestra.run.vm03.stdout:ID_LIKE="rhel fedora" 2026-03-09T18:17:52.630 INFO:teuthology.orchestra.run.vm03.stdout:VERSION_ID="9" 2026-03-09T18:17:52.630 INFO:teuthology.orchestra.run.vm03.stdout:PLATFORM_ID="platform:el9" 2026-03-09T18:17:52.630 INFO:teuthology.orchestra.run.vm03.stdout:PRETTY_NAME="CentOS Stream 9" 2026-03-09T18:17:52.630 INFO:teuthology.orchestra.run.vm03.stdout:ANSI_COLOR="0;31" 2026-03-09T18:17:52.630 INFO:teuthology.orchestra.run.vm03.stdout:LOGO="fedora-logo-icon" 2026-03-09T18:17:52.630 INFO:teuthology.orchestra.run.vm03.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-03-09T18:17:52.630 INFO:teuthology.orchestra.run.vm03.stdout:HOME_URL="https://centos.org/" 2026-03-09T18:17:52.630 INFO:teuthology.orchestra.run.vm03.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-03-09T18:17:52.630 INFO:teuthology.orchestra.run.vm03.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-03-09T18:17:52.630 INFO:teuthology.orchestra.run.vm03.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-03-09T18:17:52.630 INFO:teuthology.lock.ops:Updating vm03.local on lock server 2026-03-09T18:17:52.635 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-03-09T18:17:52.637 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-03-09T18:17:52.638 INFO:teuthology.task.internal:Checking for old test directory... 2026-03-09T18:17:52.638 DEBUG:teuthology.orchestra.run.vm02:> test '!' -e /home/ubuntu/cephtest 2026-03-09T18:17:52.640 DEBUG:teuthology.orchestra.run.vm03:> test '!' -e /home/ubuntu/cephtest 2026-03-09T18:17:52.687 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-03-09T18:17:52.688 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-03-09T18:17:52.688 DEBUG:teuthology.orchestra.run.vm02:> test -z $(ls -A /var/lib/ceph) 2026-03-09T18:17:52.700 DEBUG:teuthology.orchestra.run.vm03:> test -z $(ls -A /var/lib/ceph) 2026-03-09T18:17:52.716 INFO:teuthology.orchestra.run.vm02.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-03-09T18:17:52.746 INFO:teuthology.orchestra.run.vm03.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-03-09T18:17:52.746 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-03-09T18:17:52.755 DEBUG:teuthology.orchestra.run.vm02:> test -e /ceph-qa-ready 2026-03-09T18:17:52.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T18:17:52.973 DEBUG:teuthology.orchestra.run.vm03:> test -e /ceph-qa-ready 2026-03-09T18:17:52.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T18:17:53.187 INFO:teuthology.run_tasks:Running task internal.base... 2026-03-09T18:17:53.188 INFO:teuthology.task.internal:Creating test directory... 2026-03-09T18:17:53.189 DEBUG:teuthology.orchestra.run.vm02:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-03-09T18:17:53.191 DEBUG:teuthology.orchestra.run.vm03:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-03-09T18:17:53.208 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-03-09T18:17:53.210 INFO:teuthology.run_tasks:Running task internal.archive... 2026-03-09T18:17:53.211 INFO:teuthology.task.internal:Creating archive directory... 2026-03-09T18:17:53.211 DEBUG:teuthology.orchestra.run.vm02:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-03-09T18:17:53.249 DEBUG:teuthology.orchestra.run.vm03:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-03-09T18:17:53.271 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-03-09T18:17:53.272 INFO:teuthology.task.internal:Enabling coredump saving... 2026-03-09T18:17:53.272 DEBUG:teuthology.orchestra.run.vm02:> test -f /run/.containerenv -o -f /.dockerenv 2026-03-09T18:17:53.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T18:17:53.319 DEBUG:teuthology.orchestra.run.vm03:> test -f /run/.containerenv -o -f /.dockerenv 2026-03-09T18:17:53.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T18:17:53.333 DEBUG:teuthology.orchestra.run.vm02:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-03-09T18:17:53.360 DEBUG:teuthology.orchestra.run.vm03:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-03-09T18:17:53.384 INFO:teuthology.orchestra.run.vm02.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-09T18:17:53.394 INFO:teuthology.orchestra.run.vm02.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-09T18:17:53.398 INFO:teuthology.orchestra.run.vm03.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-09T18:17:53.409 INFO:teuthology.orchestra.run.vm03.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-03-09T18:17:53.410 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-03-09T18:17:53.411 INFO:teuthology.task.internal:Configuring sudo... 2026-03-09T18:17:53.412 DEBUG:teuthology.orchestra.run.vm02:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-03-09T18:17:53.437 DEBUG:teuthology.orchestra.run.vm03:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-03-09T18:17:53.480 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-03-09T18:17:53.482 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-03-09T18:17:53.482 DEBUG:teuthology.orchestra.run.vm02:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-03-09T18:17:53.501 DEBUG:teuthology.orchestra.run.vm03:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-03-09T18:17:53.541 DEBUG:teuthology.orchestra.run.vm02:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-09T18:17:53.578 DEBUG:teuthology.orchestra.run.vm02:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-09T18:17:53.635 DEBUG:teuthology.orchestra.run.vm02:> set -ex 2026-03-09T18:17:53.635 DEBUG:teuthology.orchestra.run.vm02:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-03-09T18:17:53.696 DEBUG:teuthology.orchestra.run.vm03:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-09T18:17:53.720 DEBUG:teuthology.orchestra.run.vm03:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-09T18:17:53.779 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T18:17:53.779 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-03-09T18:17:53.843 DEBUG:teuthology.orchestra.run.vm02:> sudo service rsyslog restart 2026-03-09T18:17:53.845 DEBUG:teuthology.orchestra.run.vm03:> sudo service rsyslog restart 2026-03-09T18:17:53.871 INFO:teuthology.orchestra.run.vm02.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-09T18:17:53.913 INFO:teuthology.orchestra.run.vm03.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-09T18:17:54.366 INFO:teuthology.run_tasks:Running task internal.timer... 2026-03-09T18:17:54.367 INFO:teuthology.task.internal:Starting timer... 2026-03-09T18:17:54.367 INFO:teuthology.run_tasks:Running task pcp... 2026-03-09T18:17:54.370 INFO:teuthology.run_tasks:Running task selinux... 2026-03-09T18:17:54.372 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2026-03-09T18:17:54.373 INFO:teuthology.task.selinux:Excluding vm02: VMs are not yet supported 2026-03-09T18:17:54.373 INFO:teuthology.task.selinux:Excluding vm03: VMs are not yet supported 2026-03-09T18:17:54.373 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-03-09T18:17:54.373 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-03-09T18:17:54.373 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-03-09T18:17:54.373 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-03-09T18:17:54.374 DEBUG:teuthology.task:Applying overrides for task ansible.cephlab: {'branch': 'main', 'skip_tags': 'nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs', 'vars': {'timezone': 'UTC'}} 2026-03-09T18:17:54.374 DEBUG:teuthology.repo_utils:Setting repo remote to https://github.com/ceph/ceph-cm-ansible.git 2026-03-09T18:17:54.376 INFO:teuthology.repo_utils:Fetching github.com_ceph_ceph-cm-ansible_main from origin 2026-03-09T18:17:54.877 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthos/src/github.com_ceph_ceph-cm-ansible_main to origin/main 2026-03-09T18:17:54.884 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-03-09T18:17:54.884 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu", "timezone": "UTC"}' -i /tmp/teuth_ansible_inventoryq7hvvsrp --limit vm02.local,vm03.local /home/teuthos/src/github.com_ceph_ceph-cm-ansible_main/cephlab.yml --skip-tags nagios,monitoring-scripts,hostname,pubkeys,zap,sudoers,kerberos,ntp-client,resolvconf,cpan,nfs 2026-03-09T18:20:11.539 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@vm02.local'), Remote(name='ubuntu@vm03.local')] 2026-03-09T18:20:11.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@vm02.local' 2026-03-09T18:20:11.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm02.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-09T18:20:11.605 DEBUG:teuthology.orchestra.run.vm02:> true 2026-03-09T18:20:11.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@vm02.local' 2026-03-09T18:20:11.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@vm03.local' 2026-03-09T18:20:11.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'vm03.local', 'username': 'ubuntu', 'timeout': 60} 2026-03-09T18:20:11.758 DEBUG:teuthology.orchestra.run.vm03:> true 2026-03-09T18:20:11.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@vm03.local' 2026-03-09T18:20:11.839 INFO:teuthology.run_tasks:Running task clock... 2026-03-09T18:20:11.841 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-03-09T18:20:11.841 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-03-09T18:20:11.842 DEBUG:teuthology.orchestra.run.vm02:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-09T18:20:11.844 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-03-09T18:20:11.845 DEBUG:teuthology.orchestra.run.vm03:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-09T18:20:11.875 INFO:teuthology.orchestra.run.vm02.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-03-09T18:20:11.889 INFO:teuthology.orchestra.run.vm02.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-03-09T18:20:11.916 INFO:teuthology.orchestra.run.vm02.stderr:sudo: ntpd: command not found 2026-03-09T18:20:11.917 INFO:teuthology.orchestra.run.vm03.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-03-09T18:20:11.929 INFO:teuthology.orchestra.run.vm02.stdout:506 Cannot talk to daemon 2026-03-09T18:20:11.936 INFO:teuthology.orchestra.run.vm03.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-03-09T18:20:11.947 INFO:teuthology.orchestra.run.vm02.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-03-09T18:20:11.962 INFO:teuthology.orchestra.run.vm02.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-03-09T18:20:11.969 INFO:teuthology.orchestra.run.vm03.stderr:sudo: ntpd: command not found 2026-03-09T18:20:11.983 INFO:teuthology.orchestra.run.vm03.stdout:506 Cannot talk to daemon 2026-03-09T18:20:12.002 INFO:teuthology.orchestra.run.vm03.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-03-09T18:20:12.016 INFO:teuthology.orchestra.run.vm02.stderr:bash: line 1: ntpq: command not found 2026-03-09T18:20:12.017 INFO:teuthology.orchestra.run.vm03.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-03-09T18:20:12.018 INFO:teuthology.orchestra.run.vm02.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-09T18:20:12.018 INFO:teuthology.orchestra.run.vm02.stdout:=============================================================================== 2026-03-09T18:20:12.079 INFO:teuthology.orchestra.run.vm03.stderr:bash: line 1: ntpq: command not found 2026-03-09T18:20:12.082 INFO:teuthology.orchestra.run.vm03.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-09T18:20:12.082 INFO:teuthology.orchestra.run.vm03.stdout:=============================================================================== 2026-03-09T18:20:12.082 INFO:teuthology.run_tasks:Running task pexec... 2026-03-09T18:20:12.085 INFO:teuthology.task.pexec:Executing custom commands... 2026-03-09T18:20:12.085 DEBUG:teuthology.orchestra.run.vm02:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-03-09T18:20:12.085 DEBUG:teuthology.orchestra.run.vm03:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-03-09T18:20:12.089 DEBUG:teuthology.task.pexec:ubuntu@vm02.local< sudo dnf remove nvme-cli -y 2026-03-09T18:20:12.089 DEBUG:teuthology.task.pexec:ubuntu@vm02.local< sudo dnf install runc nvmetcli nvme-cli -y 2026-03-09T18:20:12.089 DEBUG:teuthology.task.pexec:ubuntu@vm02.local< sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf 2026-03-09T18:20:12.089 DEBUG:teuthology.task.pexec:ubuntu@vm02.local< sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf 2026-03-09T18:20:12.090 INFO:teuthology.task.pexec:Running commands on host ubuntu@vm02.local 2026-03-09T18:20:12.090 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-03-09T18:20:12.090 INFO:teuthology.task.pexec:sudo dnf install runc nvmetcli nvme-cli -y 2026-03-09T18:20:12.090 INFO:teuthology.task.pexec:sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf 2026-03-09T18:20:12.090 INFO:teuthology.task.pexec:sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf 2026-03-09T18:20:12.124 DEBUG:teuthology.task.pexec:ubuntu@vm03.local< sudo dnf remove nvme-cli -y 2026-03-09T18:20:12.125 DEBUG:teuthology.task.pexec:ubuntu@vm03.local< sudo dnf install runc nvmetcli nvme-cli -y 2026-03-09T18:20:12.125 DEBUG:teuthology.task.pexec:ubuntu@vm03.local< sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf 2026-03-09T18:20:12.125 DEBUG:teuthology.task.pexec:ubuntu@vm03.local< sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf 2026-03-09T18:20:12.125 INFO:teuthology.task.pexec:Running commands on host ubuntu@vm03.local 2026-03-09T18:20:12.125 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-03-09T18:20:12.125 INFO:teuthology.task.pexec:sudo dnf install runc nvmetcli nvme-cli -y 2026-03-09T18:20:12.125 INFO:teuthology.task.pexec:sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf 2026-03-09T18:20:12.125 INFO:teuthology.task.pexec:sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf 2026-03-09T18:20:12.294 INFO:teuthology.orchestra.run.vm02.stdout:No match for argument: nvme-cli 2026-03-09T18:20:12.294 INFO:teuthology.orchestra.run.vm02.stderr:No packages marked for removal. 2026-03-09T18:20:12.297 INFO:teuthology.orchestra.run.vm02.stdout:Dependencies resolved. 2026-03-09T18:20:12.297 INFO:teuthology.orchestra.run.vm02.stdout:Nothing to do. 2026-03-09T18:20:12.297 INFO:teuthology.orchestra.run.vm02.stdout:Complete! 2026-03-09T18:20:12.402 INFO:teuthology.orchestra.run.vm03.stdout:No match for argument: nvme-cli 2026-03-09T18:20:12.402 INFO:teuthology.orchestra.run.vm03.stderr:No packages marked for removal. 2026-03-09T18:20:12.408 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T18:20:12.409 INFO:teuthology.orchestra.run.vm03.stdout:Nothing to do. 2026-03-09T18:20:12.409 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T18:20:12.719 INFO:teuthology.orchestra.run.vm02.stdout:Last metadata expiration check: 0:01:32 ago on Mon 09 Mar 2026 06:18:40 PM UTC. 2026-03-09T18:20:12.830 INFO:teuthology.orchestra.run.vm02.stdout:Dependencies resolved. 2026-03-09T18:20:12.830 INFO:teuthology.orchestra.run.vm02.stdout:================================================================================ 2026-03-09T18:20:12.830 INFO:teuthology.orchestra.run.vm02.stdout: Package Arch Version Repository Size 2026-03-09T18:20:12.830 INFO:teuthology.orchestra.run.vm02.stdout:================================================================================ 2026-03-09T18:20:12.830 INFO:teuthology.orchestra.run.vm02.stdout:Installing: 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout: runc x86_64 4:1.4.0-2.el9 appstream 4.0 M 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout:Installing dependencies: 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout:Transaction Summary 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout:================================================================================ 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout:Install 7 Packages 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout:Total download size: 6.3 M 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout:Installed size: 24 M 2026-03-09T18:20:12.831 INFO:teuthology.orchestra.run.vm02.stdout:Downloading Packages: 2026-03-09T18:20:12.941 INFO:teuthology.orchestra.run.vm03.stdout:Last metadata expiration check: 0:01:07 ago on Mon 09 Mar 2026 06:19:05 PM UTC. 2026-03-09T18:20:13.041 INFO:teuthology.orchestra.run.vm03.stdout:Dependencies resolved. 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout: Package Arch Version Repository Size 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout:Installing: 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout: runc x86_64 4:1.4.0-2.el9 appstream 4.0 M 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout:Installing dependencies: 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout:Transaction Summary 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout:================================================================================ 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout:Install 7 Packages 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout:Total download size: 6.3 M 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout:Installed size: 24 M 2026-03-09T18:20:13.042 INFO:teuthology.orchestra.run.vm03.stdout:Downloading Packages: 2026-03-09T18:20:13.320 INFO:teuthology.orchestra.run.vm03.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 777 kB/s | 44 kB 00:00 2026-03-09T18:20:13.328 INFO:teuthology.orchestra.run.vm03.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 1.1 MB/s | 72 kB 00:00 2026-03-09T18:20:13.351 INFO:teuthology.orchestra.run.vm03.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 2.6 MB/s | 84 kB 00:00 2026-03-09T18:20:13.366 INFO:teuthology.orchestra.run.vm03.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 3.9 MB/s | 150 kB 00:00 2026-03-09T18:20:13.387 INFO:teuthology.orchestra.run.vm03.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 9.3 MB/s | 1.2 MB 00:00 2026-03-09T18:20:13.411 INFO:teuthology.orchestra.run.vm03.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 14 MB/s | 837 kB 00:00 2026-03-09T18:20:13.461 INFO:teuthology.orchestra.run.vm03.stdout:(7/7): runc-1.4.0-2.el9.x86_64.rpm 42 MB/s | 4.0 MB 00:00 2026-03-09T18:20:13.461 INFO:teuthology.orchestra.run.vm03.stdout:-------------------------------------------------------------------------------- 2026-03-09T18:20:13.461 INFO:teuthology.orchestra.run.vm03.stdout:Total 15 MB/s | 6.3 MB 00:00 2026-03-09T18:20:13.562 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction check 2026-03-09T18:20:13.570 INFO:teuthology.orchestra.run.vm03.stdout:Transaction check succeeded. 2026-03-09T18:20:13.570 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction test 2026-03-09T18:20:13.593 INFO:teuthology.orchestra.run.vm02.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 228 kB/s | 44 kB 00:00 2026-03-09T18:20:13.593 INFO:teuthology.orchestra.run.vm02.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 372 kB/s | 72 kB 00:00 2026-03-09T18:20:13.655 INFO:teuthology.orchestra.run.vm03.stdout:Transaction test succeeded. 2026-03-09T18:20:13.655 INFO:teuthology.orchestra.run.vm03.stdout:Running transaction 2026-03-09T18:20:13.688 INFO:teuthology.orchestra.run.vm02.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 883 kB/s | 84 kB 00:00 2026-03-09T18:20:13.689 INFO:teuthology.orchestra.run.vm02.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 1.5 MB/s | 150 kB 00:00 2026-03-09T18:20:13.783 INFO:teuthology.orchestra.run.vm02.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 3.0 MB/s | 1.2 MB 00:00 2026-03-09T18:20:13.837 INFO:teuthology.orchestra.run.vm02.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 5.5 MB/s | 837 kB 00:00 2026-03-09T18:20:13.886 INFO:teuthology.orchestra.run.vm03.stdout: Preparing : 1/1 2026-03-09T18:20:13.898 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/7 2026-03-09T18:20:13.914 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 2/7 2026-03-09T18:20:13.923 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-03-09T18:20:13.931 INFO:teuthology.orchestra.run.vm03.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/7 2026-03-09T18:20:13.933 INFO:teuthology.orchestra.run.vm03.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/7 2026-03-09T18:20:13.995 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/7 2026-03-09T18:20:14.020 INFO:teuthology.orchestra.run.vm02.stdout:(7/7): runc-1.4.0-2.el9.x86_64.rpm 12 MB/s | 4.0 MB 00:00 2026-03-09T18:20:14.020 INFO:teuthology.orchestra.run.vm02.stdout:-------------------------------------------------------------------------------- 2026-03-09T18:20:14.020 INFO:teuthology.orchestra.run.vm02.stdout:Total 5.3 MB/s | 6.3 MB 00:01 2026-03-09T18:20:14.114 INFO:teuthology.orchestra.run.vm02.stdout:Running transaction check 2026-03-09T18:20:14.124 INFO:teuthology.orchestra.run.vm02.stdout:Transaction check succeeded. 2026-03-09T18:20:14.124 INFO:teuthology.orchestra.run.vm02.stdout:Running transaction test 2026-03-09T18:20:14.169 INFO:teuthology.orchestra.run.vm03.stdout: Installing : runc-4:1.4.0-2.el9.x86_64 6/7 2026-03-09T18:20:14.177 INFO:teuthology.orchestra.run.vm03.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/7 2026-03-09T18:20:14.194 INFO:teuthology.orchestra.run.vm02.stdout:Transaction test succeeded. 2026-03-09T18:20:14.195 INFO:teuthology.orchestra.run.vm02.stdout:Running transaction 2026-03-09T18:20:14.371 INFO:teuthology.orchestra.run.vm02.stdout: Preparing : 1/1 2026-03-09T18:20:14.381 INFO:teuthology.orchestra.run.vm02.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/7 2026-03-09T18:20:14.392 INFO:teuthology.orchestra.run.vm02.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 2/7 2026-03-09T18:20:14.400 INFO:teuthology.orchestra.run.vm02.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-03-09T18:20:14.409 INFO:teuthology.orchestra.run.vm02.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/7 2026-03-09T18:20:14.412 INFO:teuthology.orchestra.run.vm02.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/7 2026-03-09T18:20:14.468 INFO:teuthology.orchestra.run.vm02.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/7 2026-03-09T18:20:14.611 INFO:teuthology.orchestra.run.vm02.stdout: Installing : runc-4:1.4.0-2.el9.x86_64 6/7 2026-03-09T18:20:14.619 INFO:teuthology.orchestra.run.vm02.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/7 2026-03-09T18:20:14.622 INFO:teuthology.orchestra.run.vm03.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/7 2026-03-09T18:20:14.623 INFO:teuthology.orchestra.run.vm03.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-03-09T18:20:14.623 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T18:20:15.010 INFO:teuthology.orchestra.run.vm02.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/7 2026-03-09T18:20:15.010 INFO:teuthology.orchestra.run.vm02.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-03-09T18:20:15.010 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:20:15.263 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/7 2026-03-09T18:20:15.263 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/7 2026-03-09T18:20:15.263 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-03-09T18:20:15.263 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/7 2026-03-09T18:20:15.263 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/7 2026-03-09T18:20:15.263 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/7 2026-03-09T18:20:15.363 INFO:teuthology.orchestra.run.vm03.stdout: Verifying : runc-4:1.4.0-2.el9.x86_64 7/7 2026-03-09T18:20:15.363 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T18:20:15.363 INFO:teuthology.orchestra.run.vm03.stdout:Installed: 2026-03-09T18:20:15.363 INFO:teuthology.orchestra.run.vm03.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-03-09T18:20:15.363 INFO:teuthology.orchestra.run.vm03.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-03-09T18:20:15.363 INFO:teuthology.orchestra.run.vm03.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-03-09T18:20:15.363 INFO:teuthology.orchestra.run.vm03.stdout: runc-4:1.4.0-2.el9.x86_64 2026-03-09T18:20:15.363 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T18:20:15.363 INFO:teuthology.orchestra.run.vm03.stdout:Complete! 2026-03-09T18:20:15.488 DEBUG:teuthology.parallel:result is None 2026-03-09T18:20:15.665 INFO:teuthology.orchestra.run.vm02.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/7 2026-03-09T18:20:15.665 INFO:teuthology.orchestra.run.vm02.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/7 2026-03-09T18:20:15.665 INFO:teuthology.orchestra.run.vm02.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-03-09T18:20:15.665 INFO:teuthology.orchestra.run.vm02.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/7 2026-03-09T18:20:15.665 INFO:teuthology.orchestra.run.vm02.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/7 2026-03-09T18:20:15.665 INFO:teuthology.orchestra.run.vm02.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/7 2026-03-09T18:20:15.774 INFO:teuthology.orchestra.run.vm02.stdout: Verifying : runc-4:1.4.0-2.el9.x86_64 7/7 2026-03-09T18:20:15.774 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:20:15.774 INFO:teuthology.orchestra.run.vm02.stdout:Installed: 2026-03-09T18:20:15.774 INFO:teuthology.orchestra.run.vm02.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-03-09T18:20:15.775 INFO:teuthology.orchestra.run.vm02.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-03-09T18:20:15.775 INFO:teuthology.orchestra.run.vm02.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-03-09T18:20:15.775 INFO:teuthology.orchestra.run.vm02.stdout: runc-4:1.4.0-2.el9.x86_64 2026-03-09T18:20:15.775 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:20:15.775 INFO:teuthology.orchestra.run.vm02.stdout:Complete! 2026-03-09T18:20:15.905 DEBUG:teuthology.parallel:result is None 2026-03-09T18:20:15.905 INFO:teuthology.run_tasks:Running task nvme_loop... 2026-03-09T18:20:15.908 INFO:tasks.nvme_loop:Setting up nvme_loop on scratch devices... 2026-03-09T18:20:15.908 DEBUG:teuthology.orchestra.run.vm02:> set -ex 2026-03-09T18:20:15.908 DEBUG:teuthology.orchestra.run.vm02:> dd if=/scratch_devs of=/dev/stdout 2026-03-09T18:20:15.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T18:20:15.933 DEBUG:teuthology.orchestra.run.vm02:> ls /dev/[sv]d? 2026-03-09T18:20:15.998 INFO:teuthology.orchestra.run.vm02.stdout:/dev/vda 2026-03-09T18:20:15.998 INFO:teuthology.orchestra.run.vm02.stdout:/dev/vdb 2026-03-09T18:20:15.998 INFO:teuthology.orchestra.run.vm02.stdout:/dev/vdc 2026-03-09T18:20:15.998 INFO:teuthology.orchestra.run.vm02.stdout:/dev/vdd 2026-03-09T18:20:15.998 INFO:teuthology.orchestra.run.vm02.stdout:/dev/vde 2026-03-09T18:20:15.998 WARNING:teuthology.misc:Removing root device: /dev/vda from device list 2026-03-09T18:20:15.998 DEBUG:teuthology.misc:devs=['/dev/vdb', '/dev/vdc', '/dev/vdd', '/dev/vde'] 2026-03-09T18:20:15.998 DEBUG:teuthology.orchestra.run.vm02:> stat /dev/vdb 2026-03-09T18:20:16.082 INFO:teuthology.orchestra.run.vm02.stdout: File: /dev/vdb 2026-03-09T18:20:16.082 INFO:teuthology.orchestra.run.vm02.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:20:16.082 INFO:teuthology.orchestra.run.vm02.stdout:Device: 6h/6d Inode: 241 Links: 1 Device type: fc,10 2026-03-09T18:20:16.082 INFO:teuthology.orchestra.run.vm02.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:20:16.082 INFO:teuthology.orchestra.run.vm02.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:20:16.082 INFO:teuthology.orchestra.run.vm02.stdout:Access: 2026-03-09 18:20:15.079922329 +0000 2026-03-09T18:20:16.082 INFO:teuthology.orchestra.run.vm02.stdout:Modify: 2026-03-09 18:20:15.079922329 +0000 2026-03-09T18:20:16.082 INFO:teuthology.orchestra.run.vm02.stdout:Change: 2026-03-09 18:20:15.079922329 +0000 2026-03-09T18:20:16.082 INFO:teuthology.orchestra.run.vm02.stdout: Birth: 2026-03-09 18:16:33.274000000 +0000 2026-03-09T18:20:16.083 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/vdb of=/dev/null count=1 2026-03-09T18:20:16.120 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records in 2026-03-09T18:20:16.120 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records out 2026-03-09T18:20:16.120 INFO:teuthology.orchestra.run.vm02.stderr:512 bytes copied, 0.000148598 s, 3.4 MB/s 2026-03-09T18:20:16.122 DEBUG:teuthology.orchestra.run.vm02:> ! mount | grep -v devtmpfs | grep -q /dev/vdb 2026-03-09T18:20:16.188 DEBUG:teuthology.orchestra.run.vm02:> stat /dev/vdc 2026-03-09T18:20:16.255 INFO:teuthology.orchestra.run.vm02.stdout: File: /dev/vdc 2026-03-09T18:20:16.255 INFO:teuthology.orchestra.run.vm02.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:20:16.255 INFO:teuthology.orchestra.run.vm02.stdout:Device: 6h/6d Inode: 255 Links: 1 Device type: fc,20 2026-03-09T18:20:16.255 INFO:teuthology.orchestra.run.vm02.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:20:16.255 INFO:teuthology.orchestra.run.vm02.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:20:16.255 INFO:teuthology.orchestra.run.vm02.stdout:Access: 2026-03-09 18:20:15.083922334 +0000 2026-03-09T18:20:16.255 INFO:teuthology.orchestra.run.vm02.stdout:Modify: 2026-03-09 18:20:15.083922334 +0000 2026-03-09T18:20:16.255 INFO:teuthology.orchestra.run.vm02.stdout:Change: 2026-03-09 18:20:15.083922334 +0000 2026-03-09T18:20:16.255 INFO:teuthology.orchestra.run.vm02.stdout: Birth: 2026-03-09 18:16:33.286000000 +0000 2026-03-09T18:20:16.255 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/vdc of=/dev/null count=1 2026-03-09T18:20:16.334 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records in 2026-03-09T18:20:16.334 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records out 2026-03-09T18:20:16.334 INFO:teuthology.orchestra.run.vm02.stderr:512 bytes copied, 0.00018747 s, 2.7 MB/s 2026-03-09T18:20:16.335 DEBUG:teuthology.orchestra.run.vm02:> ! mount | grep -v devtmpfs | grep -q /dev/vdc 2026-03-09T18:20:16.402 DEBUG:teuthology.orchestra.run.vm02:> stat /dev/vdd 2026-03-09T18:20:16.464 INFO:teuthology.orchestra.run.vm02.stdout: File: /dev/vdd 2026-03-09T18:20:16.465 INFO:teuthology.orchestra.run.vm02.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:20:16.465 INFO:teuthology.orchestra.run.vm02.stdout:Device: 6h/6d Inode: 256 Links: 1 Device type: fc,30 2026-03-09T18:20:16.465 INFO:teuthology.orchestra.run.vm02.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:20:16.465 INFO:teuthology.orchestra.run.vm02.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:20:16.465 INFO:teuthology.orchestra.run.vm02.stdout:Access: 2026-03-09 18:20:15.091922342 +0000 2026-03-09T18:20:16.465 INFO:teuthology.orchestra.run.vm02.stdout:Modify: 2026-03-09 18:20:15.091922342 +0000 2026-03-09T18:20:16.465 INFO:teuthology.orchestra.run.vm02.stdout:Change: 2026-03-09 18:20:15.091922342 +0000 2026-03-09T18:20:16.465 INFO:teuthology.orchestra.run.vm02.stdout: Birth: 2026-03-09 18:16:33.290000000 +0000 2026-03-09T18:20:16.465 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/vdd of=/dev/null count=1 2026-03-09T18:20:16.531 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records in 2026-03-09T18:20:16.531 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records out 2026-03-09T18:20:16.531 INFO:teuthology.orchestra.run.vm02.stderr:512 bytes copied, 0.000126145 s, 4.1 MB/s 2026-03-09T18:20:16.532 DEBUG:teuthology.orchestra.run.vm02:> ! mount | grep -v devtmpfs | grep -q /dev/vdd 2026-03-09T18:20:16.594 DEBUG:teuthology.orchestra.run.vm02:> stat /dev/vde 2026-03-09T18:20:16.655 INFO:teuthology.orchestra.run.vm02.stdout: File: /dev/vde 2026-03-09T18:20:16.655 INFO:teuthology.orchestra.run.vm02.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:20:16.655 INFO:teuthology.orchestra.run.vm02.stdout:Device: 6h/6d Inode: 257 Links: 1 Device type: fc,40 2026-03-09T18:20:16.655 INFO:teuthology.orchestra.run.vm02.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:20:16.655 INFO:teuthology.orchestra.run.vm02.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:20:16.655 INFO:teuthology.orchestra.run.vm02.stdout:Access: 2026-03-09 18:20:15.090922341 +0000 2026-03-09T18:20:16.655 INFO:teuthology.orchestra.run.vm02.stdout:Modify: 2026-03-09 18:20:15.090922341 +0000 2026-03-09T18:20:16.655 INFO:teuthology.orchestra.run.vm02.stdout:Change: 2026-03-09 18:20:15.090922341 +0000 2026-03-09T18:20:16.655 INFO:teuthology.orchestra.run.vm02.stdout: Birth: 2026-03-09 18:16:33.320000000 +0000 2026-03-09T18:20:16.655 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/vde of=/dev/null count=1 2026-03-09T18:20:16.733 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records in 2026-03-09T18:20:16.733 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records out 2026-03-09T18:20:16.733 INFO:teuthology.orchestra.run.vm02.stderr:512 bytes copied, 0.00014447 s, 3.5 MB/s 2026-03-09T18:20:16.735 DEBUG:teuthology.orchestra.run.vm02:> ! mount | grep -v devtmpfs | grep -q /dev/vde 2026-03-09T18:20:16.793 DEBUG:teuthology.orchestra.run.vm02:> grep '^nvme_loop' /proc/modules || sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2026-03-09T18:20:16.929 INFO:teuthology.orchestra.run.vm02.stdout:loop 2026-03-09T18:20:16.930 INFO:tasks.nvme_loop:Connecting nvme_loop vm02:/dev/vdb... 2026-03-09T18:20:16.931 DEBUG:teuthology.orchestra.run.vm02:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vdb && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vdb/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vdb/namespaces/1 && echo -n /dev/vdb | sudo tee /sys/kernel/config/nvmet/subsystems/vdb/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vdb/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/vdb /sys/kernel/config/nvmet/ports/1/subsystems/vdb && sudo nvme connect -t loop -n vdb -q hostnqn 2026-03-09T18:20:16.980 INFO:teuthology.orchestra.run.vm02.stdout:1 2026-03-09T18:20:17.016 INFO:teuthology.orchestra.run.vm02.stdout:/dev/vdb1 2026-03-09T18:20:17.045 INFO:teuthology.orchestra.run.vm02.stdout:connecting to device: nvme0 2026-03-09T18:20:17.048 INFO:tasks.nvme_loop:Connecting nvme_loop vm02:/dev/vdc... 2026-03-09T18:20:17.048 DEBUG:teuthology.orchestra.run.vm02:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vdc && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vdc/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vdc/namespaces/1 && echo -n /dev/vdc | sudo tee /sys/kernel/config/nvmet/subsystems/vdc/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vdc/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/vdc /sys/kernel/config/nvmet/ports/1/subsystems/vdc && sudo nvme connect -t loop -n vdc -q hostnqn 2026-03-09T18:20:17.088 INFO:teuthology.orchestra.run.vm02.stdout:1 2026-03-09T18:20:17.123 INFO:teuthology.orchestra.run.vm02.stdout:/dev/vdc1 2026-03-09T18:20:17.156 INFO:teuthology.orchestra.run.vm02.stdout:connecting to device: nvme1 2026-03-09T18:20:17.157 INFO:tasks.nvme_loop:Connecting nvme_loop vm02:/dev/vdd... 2026-03-09T18:20:17.158 DEBUG:teuthology.orchestra.run.vm02:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vdd && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vdd/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vdd/namespaces/1 && echo -n /dev/vdd | sudo tee /sys/kernel/config/nvmet/subsystems/vdd/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vdd/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/vdd /sys/kernel/config/nvmet/ports/1/subsystems/vdd && sudo nvme connect -t loop -n vdd -q hostnqn 2026-03-09T18:20:17.252 INFO:teuthology.orchestra.run.vm02.stdout:1 2026-03-09T18:20:17.285 INFO:teuthology.orchestra.run.vm02.stdout:/dev/vdd1 2026-03-09T18:20:17.313 INFO:teuthology.orchestra.run.vm02.stdout:connecting to device: nvme2 2026-03-09T18:20:17.315 INFO:tasks.nvme_loop:Connecting nvme_loop vm02:/dev/vde... 2026-03-09T18:20:17.315 DEBUG:teuthology.orchestra.run.vm02:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vde && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vde/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vde/namespaces/1 && echo -n /dev/vde | sudo tee /sys/kernel/config/nvmet/subsystems/vde/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vde/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/vde /sys/kernel/config/nvmet/ports/1/subsystems/vde && sudo nvme connect -t loop -n vde -q hostnqn 2026-03-09T18:20:17.359 INFO:teuthology.orchestra.run.vm02.stdout:1 2026-03-09T18:20:17.393 INFO:teuthology.orchestra.run.vm02.stdout:/dev/vde1 2026-03-09T18:20:17.422 INFO:teuthology.orchestra.run.vm02.stdout:connecting to device: nvme3 2026-03-09T18:20:17.426 DEBUG:teuthology.orchestra.run.vm02:> lsblk 2026-03-09T18:20:17.449 INFO:teuthology.orchestra.run.vm02.stdout:NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS 2026-03-09T18:20:17.450 INFO:teuthology.orchestra.run.vm02.stdout:sr0 11:0 1 366K 0 rom 2026-03-09T18:20:17.450 INFO:teuthology.orchestra.run.vm02.stdout:vda 252:0 0 40G 0 disk 2026-03-09T18:20:17.450 INFO:teuthology.orchestra.run.vm02.stdout:└─vda1 252:1 0 40G 0 part / 2026-03-09T18:20:17.450 INFO:teuthology.orchestra.run.vm02.stdout:vdb 252:16 0 20G 0 disk 2026-03-09T18:20:17.450 INFO:teuthology.orchestra.run.vm02.stdout:vdc 252:32 0 20G 0 disk 2026-03-09T18:20:17.450 INFO:teuthology.orchestra.run.vm02.stdout:vdd 252:48 0 20G 0 disk 2026-03-09T18:20:17.450 INFO:teuthology.orchestra.run.vm02.stdout:vde 252:64 0 20G 0 disk 2026-03-09T18:20:17.450 INFO:teuthology.orchestra.run.vm02.stdout:nvme0n1 259:1 0 20G 0 disk 2026-03-09T18:20:17.450 INFO:teuthology.orchestra.run.vm02.stdout:nvme1n1 259:2 0 20G 0 disk 2026-03-09T18:20:17.450 INFO:teuthology.orchestra.run.vm02.stdout:nvme2n1 259:5 0 20G 0 disk 2026-03-09T18:20:17.450 INFO:teuthology.orchestra.run.vm02.stdout:nvme3n1 259:7 0 20G 0 disk 2026-03-09T18:20:17.450 DEBUG:teuthology.orchestra.run.vm02:> sudo nvme list -o json 2026-03-09T18:20:17.521 INFO:teuthology.orchestra.run.vm02.stdout:{ 2026-03-09T18:20:17.521 INFO:teuthology.orchestra.run.vm02.stdout: "Devices":[ 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: { 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "NameSpace":1, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "DevicePath":"/dev/nvme0n1", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "GenericPath":"/dev/ng0n1", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "Firmware":"5.14.0-6", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "ModelNumber":"Linux", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "SerialNumber":"931875c217b8806cdaa6", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "UsedBytes":21474836480, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "MaximumLBA":41943040, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "PhysicalSize":21474836480, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "SectorSize":512 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: }, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: { 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "NameSpace":1, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "DevicePath":"/dev/nvme1n1", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "GenericPath":"/dev/ng1n1", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "Firmware":"5.14.0-6", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "ModelNumber":"Linux", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "SerialNumber":"aa05b6f0d3806aaace4a", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "UsedBytes":21474836480, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "MaximumLBA":41943040, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "PhysicalSize":21474836480, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "SectorSize":512 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: }, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: { 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "NameSpace":1, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "DevicePath":"/dev/nvme2n1", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "GenericPath":"/dev/ng2n1", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "Firmware":"5.14.0-6", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "ModelNumber":"Linux", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "SerialNumber":"711b483328ca596a640b", 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "UsedBytes":21474836480, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "MaximumLBA":41943040, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "PhysicalSize":21474836480, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "SectorSize":512 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: }, 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: { 2026-03-09T18:20:17.522 INFO:teuthology.orchestra.run.vm02.stdout: "NameSpace":1, 2026-03-09T18:20:17.523 INFO:teuthology.orchestra.run.vm02.stdout: "DevicePath":"/dev/nvme3n1", 2026-03-09T18:20:17.523 INFO:teuthology.orchestra.run.vm02.stdout: "GenericPath":"/dev/ng3n1", 2026-03-09T18:20:17.523 INFO:teuthology.orchestra.run.vm02.stdout: "Firmware":"5.14.0-6", 2026-03-09T18:20:17.523 INFO:teuthology.orchestra.run.vm02.stdout: "ModelNumber":"Linux", 2026-03-09T18:20:17.523 INFO:teuthology.orchestra.run.vm02.stdout: "SerialNumber":"502eb0b94b5b6dc7ca8f", 2026-03-09T18:20:17.523 INFO:teuthology.orchestra.run.vm02.stdout: "UsedBytes":21474836480, 2026-03-09T18:20:17.523 INFO:teuthology.orchestra.run.vm02.stdout: "MaximumLBA":41943040, 2026-03-09T18:20:17.523 INFO:teuthology.orchestra.run.vm02.stdout: "PhysicalSize":21474836480, 2026-03-09T18:20:17.523 INFO:teuthology.orchestra.run.vm02.stdout: "SectorSize":512 2026-03-09T18:20:17.523 INFO:teuthology.orchestra.run.vm02.stdout: } 2026-03-09T18:20:17.523 INFO:teuthology.orchestra.run.vm02.stdout: ] 2026-03-09T18:20:17.523 INFO:teuthology.orchestra.run.vm02.stdout:} 2026-03-09T18:20:17.523 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/zero of=/dev/nvme0n1 seek=0 bs=1 count=4096 2026-03-09T18:20:17.594 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records in 2026-03-09T18:20:17.594 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records out 2026-03-09T18:20:17.595 INFO:teuthology.orchestra.run.vm02.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00385187 s, 1.1 MB/s 2026-03-09T18:20:17.596 DEBUG:teuthology.orchestra.run.vm02:> sudo hexdump -n22 -C -s0 /dev/nvme0n1 2026-03-09T18:20:17.666 INFO:teuthology.orchestra.run.vm02.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:17.666 INFO:teuthology.orchestra.run.vm02.stdout:00000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:17.666 INFO:teuthology.orchestra.run.vm02.stdout:00000016 2026-03-09T18:20:17.667 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/zero of=/dev/nvme0n1 seek=1073741824 bs=1 count=4096 2026-03-09T18:20:17.742 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records in 2026-03-09T18:20:17.742 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records out 2026-03-09T18:20:17.742 INFO:teuthology.orchestra.run.vm02.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00411766 s, 995 kB/s 2026-03-09T18:20:17.743 DEBUG:teuthology.orchestra.run.vm02:> sudo hexdump -n22 -C -s1073741824 /dev/nvme0n1 2026-03-09T18:20:17.815 INFO:teuthology.orchestra.run.vm02.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:17.815 INFO:teuthology.orchestra.run.vm02.stdout:40000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:17.815 INFO:teuthology.orchestra.run.vm02.stdout:40000016 2026-03-09T18:20:17.816 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/zero of=/dev/nvme0n1 seek=10737418240 bs=1 count=4096 2026-03-09T18:20:17.890 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records in 2026-03-09T18:20:17.890 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records out 2026-03-09T18:20:17.890 INFO:teuthology.orchestra.run.vm02.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00389252 s, 1.1 MB/s 2026-03-09T18:20:17.891 DEBUG:teuthology.orchestra.run.vm02:> sudo hexdump -n22 -C -s10737418240 /dev/nvme0n1 2026-03-09T18:20:17.959 INFO:teuthology.orchestra.run.vm02.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:17.959 INFO:teuthology.orchestra.run.vm02.stdout:280000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:17.959 INFO:teuthology.orchestra.run.vm02.stdout:280000016 2026-03-09T18:20:17.960 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/zero of=/dev/nvme1n1 seek=0 bs=1 count=4096 2026-03-09T18:20:18.043 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records in 2026-03-09T18:20:18.043 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records out 2026-03-09T18:20:18.043 INFO:teuthology.orchestra.run.vm02.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00524287 s, 781 kB/s 2026-03-09T18:20:18.048 DEBUG:teuthology.orchestra.run.vm02:> sudo hexdump -n22 -C -s0 /dev/nvme1n1 2026-03-09T18:20:18.078 INFO:teuthology.orchestra.run.vm02.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:18.078 INFO:teuthology.orchestra.run.vm02.stdout:00000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:18.078 INFO:teuthology.orchestra.run.vm02.stdout:00000016 2026-03-09T18:20:18.079 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/zero of=/dev/nvme1n1 seek=1073741824 bs=1 count=4096 2026-03-09T18:20:18.161 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records in 2026-03-09T18:20:18.161 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records out 2026-03-09T18:20:18.161 INFO:teuthology.orchestra.run.vm02.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00618484 s, 662 kB/s 2026-03-09T18:20:18.166 DEBUG:teuthology.orchestra.run.vm02:> sudo hexdump -n22 -C -s1073741824 /dev/nvme1n1 2026-03-09T18:20:18.239 INFO:teuthology.orchestra.run.vm02.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:18.239 INFO:teuthology.orchestra.run.vm02.stdout:40000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:18.239 INFO:teuthology.orchestra.run.vm02.stdout:40000016 2026-03-09T18:20:18.240 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/zero of=/dev/nvme1n1 seek=10737418240 bs=1 count=4096 2026-03-09T18:20:18.315 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records in 2026-03-09T18:20:18.315 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records out 2026-03-09T18:20:18.315 INFO:teuthology.orchestra.run.vm02.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00415577 s, 986 kB/s 2026-03-09T18:20:18.316 DEBUG:teuthology.orchestra.run.vm02:> sudo hexdump -n22 -C -s10737418240 /dev/nvme1n1 2026-03-09T18:20:18.392 INFO:teuthology.orchestra.run.vm02.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:18.392 INFO:teuthology.orchestra.run.vm02.stdout:280000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:18.392 INFO:teuthology.orchestra.run.vm02.stdout:280000016 2026-03-09T18:20:18.393 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/zero of=/dev/nvme2n1 seek=0 bs=1 count=4096 2026-03-09T18:20:18.473 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records in 2026-03-09T18:20:18.473 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records out 2026-03-09T18:20:18.473 INFO:teuthology.orchestra.run.vm02.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00624187 s, 656 kB/s 2026-03-09T18:20:18.477 DEBUG:teuthology.orchestra.run.vm02:> sudo hexdump -n22 -C -s0 /dev/nvme2n1 2026-03-09T18:20:18.553 INFO:teuthology.orchestra.run.vm02.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:18.553 INFO:teuthology.orchestra.run.vm02.stdout:00000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:18.553 INFO:teuthology.orchestra.run.vm02.stdout:00000016 2026-03-09T18:20:18.554 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/zero of=/dev/nvme2n1 seek=1073741824 bs=1 count=4096 2026-03-09T18:20:18.630 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records in 2026-03-09T18:20:18.631 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records out 2026-03-09T18:20:18.631 INFO:teuthology.orchestra.run.vm02.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00571899 s, 716 kB/s 2026-03-09T18:20:18.634 DEBUG:teuthology.orchestra.run.vm02:> sudo hexdump -n22 -C -s1073741824 /dev/nvme2n1 2026-03-09T18:20:18.708 INFO:teuthology.orchestra.run.vm02.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:18.708 INFO:teuthology.orchestra.run.vm02.stdout:40000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:18.708 INFO:teuthology.orchestra.run.vm02.stdout:40000016 2026-03-09T18:20:18.709 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/zero of=/dev/nvme2n1 seek=10737418240 bs=1 count=4096 2026-03-09T18:20:18.779 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records in 2026-03-09T18:20:18.779 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records out 2026-03-09T18:20:18.779 INFO:teuthology.orchestra.run.vm02.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.004746 s, 863 kB/s 2026-03-09T18:20:18.783 DEBUG:teuthology.orchestra.run.vm02:> sudo hexdump -n22 -C -s10737418240 /dev/nvme2n1 2026-03-09T18:20:18.850 INFO:teuthology.orchestra.run.vm02.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:18.850 INFO:teuthology.orchestra.run.vm02.stdout:280000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:18.850 INFO:teuthology.orchestra.run.vm02.stdout:280000016 2026-03-09T18:20:18.851 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=0 bs=1 count=4096 2026-03-09T18:20:18.927 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records in 2026-03-09T18:20:18.927 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records out 2026-03-09T18:20:18.927 INFO:teuthology.orchestra.run.vm02.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00413574 s, 990 kB/s 2026-03-09T18:20:18.929 DEBUG:teuthology.orchestra.run.vm02:> sudo hexdump -n22 -C -s0 /dev/nvme3n1 2026-03-09T18:20:19.002 INFO:teuthology.orchestra.run.vm02.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:19.003 INFO:teuthology.orchestra.run.vm02.stdout:00000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:19.003 INFO:teuthology.orchestra.run.vm02.stdout:00000016 2026-03-09T18:20:19.004 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=1073741824 bs=1 count=4096 2026-03-09T18:20:19.082 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records in 2026-03-09T18:20:19.082 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records out 2026-03-09T18:20:19.082 INFO:teuthology.orchestra.run.vm02.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00500847 s, 818 kB/s 2026-03-09T18:20:19.087 DEBUG:teuthology.orchestra.run.vm02:> sudo hexdump -n22 -C -s1073741824 /dev/nvme3n1 2026-03-09T18:20:19.158 INFO:teuthology.orchestra.run.vm02.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:19.159 INFO:teuthology.orchestra.run.vm02.stdout:40000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:19.159 INFO:teuthology.orchestra.run.vm02.stdout:40000016 2026-03-09T18:20:19.161 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=10737418240 bs=1 count=4096 2026-03-09T18:20:19.236 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records in 2026-03-09T18:20:19.236 INFO:teuthology.orchestra.run.vm02.stderr:4096+0 records out 2026-03-09T18:20:19.236 INFO:teuthology.orchestra.run.vm02.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00512686 s, 799 kB/s 2026-03-09T18:20:19.241 DEBUG:teuthology.orchestra.run.vm02:> sudo hexdump -n22 -C -s10737418240 /dev/nvme3n1 2026-03-09T18:20:19.310 INFO:teuthology.orchestra.run.vm02.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:19.310 INFO:teuthology.orchestra.run.vm02.stdout:280000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:19.310 INFO:teuthology.orchestra.run.vm02.stdout:280000016 2026-03-09T18:20:19.311 INFO:tasks.nvme_loop:new_devs ['/dev/nvme0n1', '/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1'] 2026-03-09T18:20:19.311 DEBUG:teuthology.orchestra.run.vm02:> set -ex 2026-03-09T18:20:19.311 DEBUG:teuthology.orchestra.run.vm02:> sudo dd of=/scratch_devs 2026-03-09T18:20:19.387 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T18:20:19.387 DEBUG:teuthology.orchestra.run.vm03:> dd if=/scratch_devs of=/dev/stdout 2026-03-09T18:20:19.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T18:20:19.414 DEBUG:teuthology.orchestra.run.vm03:> ls /dev/[sv]d? 2026-03-09T18:20:19.477 INFO:teuthology.orchestra.run.vm03.stdout:/dev/vda 2026-03-09T18:20:19.477 INFO:teuthology.orchestra.run.vm03.stdout:/dev/vdb 2026-03-09T18:20:19.477 INFO:teuthology.orchestra.run.vm03.stdout:/dev/vdc 2026-03-09T18:20:19.477 INFO:teuthology.orchestra.run.vm03.stdout:/dev/vdd 2026-03-09T18:20:19.477 INFO:teuthology.orchestra.run.vm03.stdout:/dev/vde 2026-03-09T18:20:19.477 WARNING:teuthology.misc:Removing root device: /dev/vda from device list 2026-03-09T18:20:19.477 DEBUG:teuthology.misc:devs=['/dev/vdb', '/dev/vdc', '/dev/vdd', '/dev/vde'] 2026-03-09T18:20:19.477 DEBUG:teuthology.orchestra.run.vm03:> stat /dev/vdb 2026-03-09T18:20:19.544 INFO:teuthology.orchestra.run.vm03.stdout: File: /dev/vdb 2026-03-09T18:20:19.544 INFO:teuthology.orchestra.run.vm03.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:20:19.544 INFO:teuthology.orchestra.run.vm03.stdout:Device: 6h/6d Inode: 223 Links: 1 Device type: fc,10 2026-03-09T18:20:19.544 INFO:teuthology.orchestra.run.vm03.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:20:19.544 INFO:teuthology.orchestra.run.vm03.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:20:19.544 INFO:teuthology.orchestra.run.vm03.stdout:Access: 2026-03-09 18:20:14.654696383 +0000 2026-03-09T18:20:19.544 INFO:teuthology.orchestra.run.vm03.stdout:Modify: 2026-03-09 18:20:14.654696383 +0000 2026-03-09T18:20:19.544 INFO:teuthology.orchestra.run.vm03.stdout:Change: 2026-03-09 18:20:14.654696383 +0000 2026-03-09T18:20:19.544 INFO:teuthology.orchestra.run.vm03.stdout: Birth: 2026-03-09 18:17:10.297000000 +0000 2026-03-09T18:20:19.544 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/vdb of=/dev/null count=1 2026-03-09T18:20:19.620 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records in 2026-03-09T18:20:19.620 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records out 2026-03-09T18:20:19.620 INFO:teuthology.orchestra.run.vm03.stderr:512 bytes copied, 0.000173806 s, 2.9 MB/s 2026-03-09T18:20:19.621 DEBUG:teuthology.orchestra.run.vm03:> ! mount | grep -v devtmpfs | grep -q /dev/vdb 2026-03-09T18:20:19.684 DEBUG:teuthology.orchestra.run.vm03:> stat /dev/vdc 2026-03-09T18:20:19.753 INFO:teuthology.orchestra.run.vm03.stdout: File: /dev/vdc 2026-03-09T18:20:19.754 INFO:teuthology.orchestra.run.vm03.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:20:19.754 INFO:teuthology.orchestra.run.vm03.stdout:Device: 6h/6d Inode: 251 Links: 1 Device type: fc,20 2026-03-09T18:20:19.754 INFO:teuthology.orchestra.run.vm03.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:20:19.754 INFO:teuthology.orchestra.run.vm03.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:20:19.754 INFO:teuthology.orchestra.run.vm03.stdout:Access: 2026-03-09 18:20:14.703696452 +0000 2026-03-09T18:20:19.754 INFO:teuthology.orchestra.run.vm03.stdout:Modify: 2026-03-09 18:20:14.703696452 +0000 2026-03-09T18:20:19.754 INFO:teuthology.orchestra.run.vm03.stdout:Change: 2026-03-09 18:20:14.703696452 +0000 2026-03-09T18:20:19.754 INFO:teuthology.orchestra.run.vm03.stdout: Birth: 2026-03-09 18:17:10.310000000 +0000 2026-03-09T18:20:19.754 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/vdc of=/dev/null count=1 2026-03-09T18:20:19.827 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records in 2026-03-09T18:20:19.828 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records out 2026-03-09T18:20:19.828 INFO:teuthology.orchestra.run.vm03.stderr:512 bytes copied, 0.00012899 s, 4.0 MB/s 2026-03-09T18:20:19.831 DEBUG:teuthology.orchestra.run.vm03:> ! mount | grep -v devtmpfs | grep -q /dev/vdc 2026-03-09T18:20:19.895 DEBUG:teuthology.orchestra.run.vm03:> stat /dev/vdd 2026-03-09T18:20:19.962 INFO:teuthology.orchestra.run.vm03.stdout: File: /dev/vdd 2026-03-09T18:20:19.962 INFO:teuthology.orchestra.run.vm03.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:20:19.962 INFO:teuthology.orchestra.run.vm03.stdout:Device: 6h/6d Inode: 256 Links: 1 Device type: fc,30 2026-03-09T18:20:19.962 INFO:teuthology.orchestra.run.vm03.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:20:19.962 INFO:teuthology.orchestra.run.vm03.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:20:19.962 INFO:teuthology.orchestra.run.vm03.stdout:Access: 2026-03-09 18:20:14.653696381 +0000 2026-03-09T18:20:19.962 INFO:teuthology.orchestra.run.vm03.stdout:Modify: 2026-03-09 18:20:14.653696381 +0000 2026-03-09T18:20:19.962 INFO:teuthology.orchestra.run.vm03.stdout:Change: 2026-03-09 18:20:14.653696381 +0000 2026-03-09T18:20:19.962 INFO:teuthology.orchestra.run.vm03.stdout: Birth: 2026-03-09 18:17:10.314000000 +0000 2026-03-09T18:20:19.962 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/vdd of=/dev/null count=1 2026-03-09T18:20:20.036 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records in 2026-03-09T18:20:20.037 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records out 2026-03-09T18:20:20.037 INFO:teuthology.orchestra.run.vm03.stderr:512 bytes copied, 0.000310079 s, 1.7 MB/s 2026-03-09T18:20:20.037 DEBUG:teuthology.orchestra.run.vm03:> ! mount | grep -v devtmpfs | grep -q /dev/vdd 2026-03-09T18:20:20.104 DEBUG:teuthology.orchestra.run.vm03:> stat /dev/vde 2026-03-09T18:20:20.168 INFO:teuthology.orchestra.run.vm03.stdout: File: /dev/vde 2026-03-09T18:20:20.168 INFO:teuthology.orchestra.run.vm03.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:20:20.168 INFO:teuthology.orchestra.run.vm03.stdout:Device: 6h/6d Inode: 257 Links: 1 Device type: fc,40 2026-03-09T18:20:20.168 INFO:teuthology.orchestra.run.vm03.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:20:20.168 INFO:teuthology.orchestra.run.vm03.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:20:20.168 INFO:teuthology.orchestra.run.vm03.stdout:Access: 2026-03-09 18:20:14.690696433 +0000 2026-03-09T18:20:20.168 INFO:teuthology.orchestra.run.vm03.stdout:Modify: 2026-03-09 18:20:14.690696433 +0000 2026-03-09T18:20:20.168 INFO:teuthology.orchestra.run.vm03.stdout:Change: 2026-03-09 18:20:14.690696433 +0000 2026-03-09T18:20:20.168 INFO:teuthology.orchestra.run.vm03.stdout: Birth: 2026-03-09 18:17:10.322000000 +0000 2026-03-09T18:20:20.168 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/vde of=/dev/null count=1 2026-03-09T18:20:20.245 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records in 2026-03-09T18:20:20.245 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records out 2026-03-09T18:20:20.245 INFO:teuthology.orchestra.run.vm03.stderr:512 bytes copied, 0.000116707 s, 4.4 MB/s 2026-03-09T18:20:20.246 DEBUG:teuthology.orchestra.run.vm03:> ! mount | grep -v devtmpfs | grep -q /dev/vde 2026-03-09T18:20:20.310 DEBUG:teuthology.orchestra.run.vm03:> grep '^nvme_loop' /proc/modules || sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2026-03-09T18:20:20.482 INFO:teuthology.orchestra.run.vm03.stdout:loop 2026-03-09T18:20:20.483 INFO:tasks.nvme_loop:Connecting nvme_loop vm03:/dev/vdb... 2026-03-09T18:20:20.484 DEBUG:teuthology.orchestra.run.vm03:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vdb && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vdb/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vdb/namespaces/1 && echo -n /dev/vdb | sudo tee /sys/kernel/config/nvmet/subsystems/vdb/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vdb/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/vdb /sys/kernel/config/nvmet/ports/1/subsystems/vdb && sudo nvme connect -t loop -n vdb -q hostnqn 2026-03-09T18:20:20.524 INFO:teuthology.orchestra.run.vm03.stdout:1 2026-03-09T18:20:20.556 INFO:teuthology.orchestra.run.vm03.stdout:/dev/vdb1 2026-03-09T18:20:20.588 INFO:teuthology.orchestra.run.vm03.stdout:connecting to device: nvme0 2026-03-09T18:20:20.590 INFO:tasks.nvme_loop:Connecting nvme_loop vm03:/dev/vdc... 2026-03-09T18:20:20.590 DEBUG:teuthology.orchestra.run.vm03:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vdc && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vdc/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vdc/namespaces/1 && echo -n /dev/vdc | sudo tee /sys/kernel/config/nvmet/subsystems/vdc/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vdc/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/vdc /sys/kernel/config/nvmet/ports/1/subsystems/vdc && sudo nvme connect -t loop -n vdc -q hostnqn 2026-03-09T18:20:20.671 INFO:teuthology.orchestra.run.vm03.stdout:1 2026-03-09T18:20:20.711 INFO:teuthology.orchestra.run.vm03.stdout:/dev/vdc1 2026-03-09T18:20:20.744 INFO:teuthology.orchestra.run.vm03.stdout:connecting to device: nvme1 2026-03-09T18:20:20.745 INFO:tasks.nvme_loop:Connecting nvme_loop vm03:/dev/vdd... 2026-03-09T18:20:20.745 DEBUG:teuthology.orchestra.run.vm03:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vdd && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vdd/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vdd/namespaces/1 && echo -n /dev/vdd | sudo tee /sys/kernel/config/nvmet/subsystems/vdd/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vdd/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/vdd /sys/kernel/config/nvmet/ports/1/subsystems/vdd && sudo nvme connect -t loop -n vdd -q hostnqn 2026-03-09T18:20:20.837 INFO:teuthology.orchestra.run.vm03.stdout:1 2026-03-09T18:20:20.881 INFO:teuthology.orchestra.run.vm03.stdout:/dev/vdd1 2026-03-09T18:20:20.915 INFO:teuthology.orchestra.run.vm03.stdout:connecting to device: nvme2 2026-03-09T18:20:20.917 INFO:tasks.nvme_loop:Connecting nvme_loop vm03:/dev/vde... 2026-03-09T18:20:20.917 DEBUG:teuthology.orchestra.run.vm03:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vde && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vde/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/vde/namespaces/1 && echo -n /dev/vde | sudo tee /sys/kernel/config/nvmet/subsystems/vde/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/vde/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/vde /sys/kernel/config/nvmet/ports/1/subsystems/vde && sudo nvme connect -t loop -n vde -q hostnqn 2026-03-09T18:20:20.971 INFO:teuthology.orchestra.run.vm03.stdout:1 2026-03-09T18:20:21.011 INFO:teuthology.orchestra.run.vm03.stdout:/dev/vde1 2026-03-09T18:20:21.042 INFO:teuthology.orchestra.run.vm03.stdout:connecting to device: nvme3 2026-03-09T18:20:21.044 DEBUG:teuthology.orchestra.run.vm03:> lsblk 2026-03-09T18:20:21.068 INFO:teuthology.orchestra.run.vm03.stdout:NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS 2026-03-09T18:20:21.068 INFO:teuthology.orchestra.run.vm03.stdout:sr0 11:0 1 366K 0 rom 2026-03-09T18:20:21.068 INFO:teuthology.orchestra.run.vm03.stdout:vda 252:0 0 40G 0 disk 2026-03-09T18:20:21.068 INFO:teuthology.orchestra.run.vm03.stdout:└─vda1 252:1 0 40G 0 part / 2026-03-09T18:20:21.068 INFO:teuthology.orchestra.run.vm03.stdout:vdb 252:16 0 20G 0 disk 2026-03-09T18:20:21.068 INFO:teuthology.orchestra.run.vm03.stdout:vdc 252:32 0 20G 0 disk 2026-03-09T18:20:21.068 INFO:teuthology.orchestra.run.vm03.stdout:vdd 252:48 0 20G 0 disk 2026-03-09T18:20:21.068 INFO:teuthology.orchestra.run.vm03.stdout:vde 252:64 0 20G 0 disk 2026-03-09T18:20:21.068 INFO:teuthology.orchestra.run.vm03.stdout:nvme0n1 259:1 0 20G 0 disk 2026-03-09T18:20:21.068 INFO:teuthology.orchestra.run.vm03.stdout:nvme1n1 259:3 0 20G 0 disk 2026-03-09T18:20:21.068 INFO:teuthology.orchestra.run.vm03.stdout:nvme2n1 259:5 0 20G 0 disk 2026-03-09T18:20:21.068 INFO:teuthology.orchestra.run.vm03.stdout:nvme3n1 259:7 0 20G 0 disk 2026-03-09T18:20:21.068 DEBUG:teuthology.orchestra.run.vm03:> sudo nvme list -o json 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout:{ 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "Devices":[ 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: { 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "NameSpace":1, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "DevicePath":"/dev/nvme0n1", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "GenericPath":"/dev/ng0n1", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "Firmware":"5.14.0-6", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "ModelNumber":"Linux", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "SerialNumber":"d9cb7421c658ad5a7047", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "UsedBytes":21474836480, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "MaximumLBA":41943040, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "PhysicalSize":21474836480, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "SectorSize":512 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: }, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: { 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "NameSpace":1, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "DevicePath":"/dev/nvme1n1", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "GenericPath":"/dev/ng1n1", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "Firmware":"5.14.0-6", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "ModelNumber":"Linux", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "SerialNumber":"02535782da3622b8e5b4", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "UsedBytes":21474836480, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "MaximumLBA":41943040, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "PhysicalSize":21474836480, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "SectorSize":512 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: }, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: { 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "NameSpace":1, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "DevicePath":"/dev/nvme2n1", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "GenericPath":"/dev/ng2n1", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "Firmware":"5.14.0-6", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "ModelNumber":"Linux", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "SerialNumber":"bfefd7b13708929cb043", 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "UsedBytes":21474836480, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "MaximumLBA":41943040, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "PhysicalSize":21474836480, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "SectorSize":512 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: }, 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: { 2026-03-09T18:20:21.145 INFO:teuthology.orchestra.run.vm03.stdout: "NameSpace":1, 2026-03-09T18:20:21.146 INFO:teuthology.orchestra.run.vm03.stdout: "DevicePath":"/dev/nvme3n1", 2026-03-09T18:20:21.146 INFO:teuthology.orchestra.run.vm03.stdout: "GenericPath":"/dev/ng3n1", 2026-03-09T18:20:21.146 INFO:teuthology.orchestra.run.vm03.stdout: "Firmware":"5.14.0-6", 2026-03-09T18:20:21.146 INFO:teuthology.orchestra.run.vm03.stdout: "ModelNumber":"Linux", 2026-03-09T18:20:21.146 INFO:teuthology.orchestra.run.vm03.stdout: "SerialNumber":"61559e2322c0a409c6be", 2026-03-09T18:20:21.146 INFO:teuthology.orchestra.run.vm03.stdout: "UsedBytes":21474836480, 2026-03-09T18:20:21.146 INFO:teuthology.orchestra.run.vm03.stdout: "MaximumLBA":41943040, 2026-03-09T18:20:21.146 INFO:teuthology.orchestra.run.vm03.stdout: "PhysicalSize":21474836480, 2026-03-09T18:20:21.146 INFO:teuthology.orchestra.run.vm03.stdout: "SectorSize":512 2026-03-09T18:20:21.146 INFO:teuthology.orchestra.run.vm03.stdout: } 2026-03-09T18:20:21.146 INFO:teuthology.orchestra.run.vm03.stdout: ] 2026-03-09T18:20:21.146 INFO:teuthology.orchestra.run.vm03.stdout:} 2026-03-09T18:20:21.146 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/zero of=/dev/nvme0n1 seek=0 bs=1 count=4096 2026-03-09T18:20:21.218 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records in 2026-03-09T18:20:21.218 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records out 2026-03-09T18:20:21.218 INFO:teuthology.orchestra.run.vm03.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00477165 s, 858 kB/s 2026-03-09T18:20:21.220 DEBUG:teuthology.orchestra.run.vm03:> sudo hexdump -n22 -C -s0 /dev/nvme0n1 2026-03-09T18:20:21.292 INFO:teuthology.orchestra.run.vm03.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:21.292 INFO:teuthology.orchestra.run.vm03.stdout:00000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:21.292 INFO:teuthology.orchestra.run.vm03.stdout:00000016 2026-03-09T18:20:21.293 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/zero of=/dev/nvme0n1 seek=1073741824 bs=1 count=4096 2026-03-09T18:20:21.376 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records in 2026-03-09T18:20:21.376 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records out 2026-03-09T18:20:21.376 INFO:teuthology.orchestra.run.vm03.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00563833 s, 726 kB/s 2026-03-09T18:20:21.381 DEBUG:teuthology.orchestra.run.vm03:> sudo hexdump -n22 -C -s1073741824 /dev/nvme0n1 2026-03-09T18:20:21.452 INFO:teuthology.orchestra.run.vm03.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:21.452 INFO:teuthology.orchestra.run.vm03.stdout:40000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:21.452 INFO:teuthology.orchestra.run.vm03.stdout:40000016 2026-03-09T18:20:21.453 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/zero of=/dev/nvme0n1 seek=10737418240 bs=1 count=4096 2026-03-09T18:20:21.533 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records in 2026-03-09T18:20:21.533 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records out 2026-03-09T18:20:21.533 INFO:teuthology.orchestra.run.vm03.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00742567 s, 552 kB/s 2026-03-09T18:20:21.534 DEBUG:teuthology.orchestra.run.vm03:> sudo hexdump -n22 -C -s10737418240 /dev/nvme0n1 2026-03-09T18:20:21.608 INFO:teuthology.orchestra.run.vm03.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:21.608 INFO:teuthology.orchestra.run.vm03.stdout:280000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:21.608 INFO:teuthology.orchestra.run.vm03.stdout:280000016 2026-03-09T18:20:21.609 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/zero of=/dev/nvme1n1 seek=0 bs=1 count=4096 2026-03-09T18:20:21.692 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records in 2026-03-09T18:20:21.692 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records out 2026-03-09T18:20:21.692 INFO:teuthology.orchestra.run.vm03.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00719628 s, 569 kB/s 2026-03-09T18:20:21.698 DEBUG:teuthology.orchestra.run.vm03:> sudo hexdump -n22 -C -s0 /dev/nvme1n1 2026-03-09T18:20:21.766 INFO:teuthology.orchestra.run.vm03.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:21.766 INFO:teuthology.orchestra.run.vm03.stdout:00000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:21.766 INFO:teuthology.orchestra.run.vm03.stdout:00000016 2026-03-09T18:20:21.769 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/zero of=/dev/nvme1n1 seek=1073741824 bs=1 count=4096 2026-03-09T18:20:21.847 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records in 2026-03-09T18:20:21.847 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records out 2026-03-09T18:20:21.847 INFO:teuthology.orchestra.run.vm03.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0054659 s, 749 kB/s 2026-03-09T18:20:21.852 DEBUG:teuthology.orchestra.run.vm03:> sudo hexdump -n22 -C -s1073741824 /dev/nvme1n1 2026-03-09T18:20:21.926 INFO:teuthology.orchestra.run.vm03.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:21.927 INFO:teuthology.orchestra.run.vm03.stdout:40000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:21.927 INFO:teuthology.orchestra.run.vm03.stdout:40000016 2026-03-09T18:20:21.928 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/zero of=/dev/nvme1n1 seek=10737418240 bs=1 count=4096 2026-03-09T18:20:22.005 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records in 2026-03-09T18:20:22.005 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records out 2026-03-09T18:20:22.005 INFO:teuthology.orchestra.run.vm03.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00729726 s, 561 kB/s 2026-03-09T18:20:22.007 DEBUG:teuthology.orchestra.run.vm03:> sudo hexdump -n22 -C -s10737418240 /dev/nvme1n1 2026-03-09T18:20:22.085 INFO:teuthology.orchestra.run.vm03.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:22.085 INFO:teuthology.orchestra.run.vm03.stdout:280000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:22.085 INFO:teuthology.orchestra.run.vm03.stdout:280000016 2026-03-09T18:20:22.089 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/zero of=/dev/nvme2n1 seek=0 bs=1 count=4096 2026-03-09T18:20:22.172 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records in 2026-03-09T18:20:22.172 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records out 2026-03-09T18:20:22.172 INFO:teuthology.orchestra.run.vm03.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00692818 s, 591 kB/s 2026-03-09T18:20:22.174 DEBUG:teuthology.orchestra.run.vm03:> sudo hexdump -n22 -C -s0 /dev/nvme2n1 2026-03-09T18:20:22.247 INFO:teuthology.orchestra.run.vm03.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:22.247 INFO:teuthology.orchestra.run.vm03.stdout:00000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:22.247 INFO:teuthology.orchestra.run.vm03.stdout:00000016 2026-03-09T18:20:22.249 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/zero of=/dev/nvme2n1 seek=1073741824 bs=1 count=4096 2026-03-09T18:20:22.321 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records in 2026-03-09T18:20:22.321 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records out 2026-03-09T18:20:22.321 INFO:teuthology.orchestra.run.vm03.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00475353 s, 862 kB/s 2026-03-09T18:20:22.326 DEBUG:teuthology.orchestra.run.vm03:> sudo hexdump -n22 -C -s1073741824 /dev/nvme2n1 2026-03-09T18:20:22.398 INFO:teuthology.orchestra.run.vm03.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:22.398 INFO:teuthology.orchestra.run.vm03.stdout:40000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:22.398 INFO:teuthology.orchestra.run.vm03.stdout:40000016 2026-03-09T18:20:22.399 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/zero of=/dev/nvme2n1 seek=10737418240 bs=1 count=4096 2026-03-09T18:20:22.481 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records in 2026-03-09T18:20:22.481 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records out 2026-03-09T18:20:22.481 INFO:teuthology.orchestra.run.vm03.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00930365 s, 440 kB/s 2026-03-09T18:20:22.483 DEBUG:teuthology.orchestra.run.vm03:> sudo hexdump -n22 -C -s10737418240 /dev/nvme2n1 2026-03-09T18:20:22.556 INFO:teuthology.orchestra.run.vm03.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:22.556 INFO:teuthology.orchestra.run.vm03.stdout:280000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:22.556 INFO:teuthology.orchestra.run.vm03.stdout:280000016 2026-03-09T18:20:22.557 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=0 bs=1 count=4096 2026-03-09T18:20:22.636 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records in 2026-03-09T18:20:22.636 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records out 2026-03-09T18:20:22.636 INFO:teuthology.orchestra.run.vm03.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00641697 s, 638 kB/s 2026-03-09T18:20:22.641 DEBUG:teuthology.orchestra.run.vm03:> sudo hexdump -n22 -C -s0 /dev/nvme3n1 2026-03-09T18:20:22.718 INFO:teuthology.orchestra.run.vm03.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:22.718 INFO:teuthology.orchestra.run.vm03.stdout:00000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:22.718 INFO:teuthology.orchestra.run.vm03.stdout:00000016 2026-03-09T18:20:22.720 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=1073741824 bs=1 count=4096 2026-03-09T18:20:22.803 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records in 2026-03-09T18:20:22.803 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records out 2026-03-09T18:20:22.803 INFO:teuthology.orchestra.run.vm03.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00853912 s, 480 kB/s 2026-03-09T18:20:22.804 DEBUG:teuthology.orchestra.run.vm03:> sudo hexdump -n22 -C -s1073741824 /dev/nvme3n1 2026-03-09T18:20:22.880 INFO:teuthology.orchestra.run.vm03.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:22.881 INFO:teuthology.orchestra.run.vm03.stdout:40000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:22.881 INFO:teuthology.orchestra.run.vm03.stdout:40000016 2026-03-09T18:20:22.881 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=10737418240 bs=1 count=4096 2026-03-09T18:20:22.961 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records in 2026-03-09T18:20:22.961 INFO:teuthology.orchestra.run.vm03.stderr:4096+0 records out 2026-03-09T18:20:22.961 INFO:teuthology.orchestra.run.vm03.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00467232 s, 877 kB/s 2026-03-09T18:20:22.965 DEBUG:teuthology.orchestra.run.vm03:> sudo hexdump -n22 -C -s10737418240 /dev/nvme3n1 2026-03-09T18:20:23.040 INFO:teuthology.orchestra.run.vm03.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-03-09T18:20:23.041 INFO:teuthology.orchestra.run.vm03.stdout:280000010 00 00 00 00 00 00 |......| 2026-03-09T18:20:23.041 INFO:teuthology.orchestra.run.vm03.stdout:280000016 2026-03-09T18:20:23.041 INFO:tasks.nvme_loop:new_devs ['/dev/nvme0n1', '/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1'] 2026-03-09T18:20:23.041 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T18:20:23.041 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/scratch_devs 2026-03-09T18:20:23.119 INFO:teuthology.run_tasks:Running task cephadm... 2026-03-09T18:20:23.170 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': True}, 'global': {'mon election default strategy': 3}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd mclock iops capacity threshold hdd': 49000, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'MON_DOWN', 'mons down', 'mon down', 'out of quorum', 'CEPHADM_STRAY_DAEMON', 'CEPHADM_FAILED_DAEMON', 'CEPHADM_AGENT_DOWN', 'PG_DEGRADED'], 'log-only-match': ['CEPHADM_'], 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df'} 2026-03-09T18:20:23.170 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T18:20:23.170 INFO:tasks.cephadm:Cluster fsid is a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:20:23.170 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-03-09T18:20:23.170 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '192.168.123.102', 'mon.c': '[v2:192.168.123.102:3301,v1:192.168.123.102:6790]', 'mon.b': '192.168.123.103'} 2026-03-09T18:20:23.170 INFO:tasks.cephadm:First mon is mon.a on vm02 2026-03-09T18:20:23.170 INFO:tasks.cephadm:First mgr is y 2026-03-09T18:20:23.170 INFO:tasks.cephadm:Normalizing hostnames... 2026-03-09T18:20:23.170 DEBUG:teuthology.orchestra.run.vm02:> sudo hostname $(hostname -s) 2026-03-09T18:20:23.201 DEBUG:teuthology.orchestra.run.vm03:> sudo hostname $(hostname -s) 2026-03-09T18:20:23.238 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-03-09T18:20:23.239 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T18:20:23.891 INFO:tasks.cephadm:builder_project result: [{'url': 'https://3.chacra.ceph.com/r/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/flavors/default/', 'ref': 'squid', 'sha1': 'e911bdebe5c8faa3800735d1568fcdca65db60df', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-25 18:55:15.146628', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '19.2.3-678-ge911bdeb', 'package_manager_version': '19.2.3-678.ge911bdeb', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3275/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-03-09T18:20:24.476 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 e911bdebe5c8faa3800735d1568fcdca65db60df from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T18:20:24.477 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/x86_64/flavors/default/cephadm 2026-03-09T18:20:24.477 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/x86_64/flavors/default/cephadm 2026-03-09T18:20:24.478 DEBUG:teuthology.orchestra.run.vm02:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-03-09T18:20:25.985 INFO:teuthology.orchestra.run.vm02.stdout:-rw-r--r--. 1 ubuntu ubuntu 788355 Mar 9 18:20 /home/ubuntu/cephtest/cephadm 2026-03-09T18:20:25.985 DEBUG:teuthology.orchestra.run.vm03:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/e911bdebe5c8faa3800735d1568fcdca65db60df/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-03-09T18:20:27.593 INFO:teuthology.orchestra.run.vm03.stdout:-rw-r--r--. 1 ubuntu ubuntu 788355 Mar 9 18:20 /home/ubuntu/cephtest/cephadm 2026-03-09T18:20:27.594 DEBUG:teuthology.orchestra.run.vm02:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-03-09T18:20:27.634 DEBUG:teuthology.orchestra.run.vm03:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-03-09T18:20:27.665 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df on all hosts... 2026-03-09T18:20:27.666 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df pull 2026-03-09T18:20:27.676 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df pull 2026-03-09T18:20:27.876 INFO:teuthology.orchestra.run.vm02.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T18:20:27.935 INFO:teuthology.orchestra.run.vm03.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T18:21:16.528 INFO:teuthology.orchestra.run.vm03.stdout:{ 2026-03-09T18:21:16.528 INFO:teuthology.orchestra.run.vm03.stdout: "ceph_version": "ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable)", 2026-03-09T18:21:16.528 INFO:teuthology.orchestra.run.vm03.stdout: "image_id": "654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c", 2026-03-09T18:21:16.528 INFO:teuthology.orchestra.run.vm03.stdout: "repo_digests": [ 2026-03-09T18:21:16.528 INFO:teuthology.orchestra.run.vm03.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc" 2026-03-09T18:21:16.528 INFO:teuthology.orchestra.run.vm03.stdout: ] 2026-03-09T18:21:16.528 INFO:teuthology.orchestra.run.vm03.stdout:} 2026-03-09T18:21:17.367 INFO:teuthology.orchestra.run.vm02.stdout:{ 2026-03-09T18:21:17.367 INFO:teuthology.orchestra.run.vm02.stdout: "ceph_version": "ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable)", 2026-03-09T18:21:17.367 INFO:teuthology.orchestra.run.vm02.stdout: "image_id": "654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c", 2026-03-09T18:21:17.367 INFO:teuthology.orchestra.run.vm02.stdout: "repo_digests": [ 2026-03-09T18:21:17.367 INFO:teuthology.orchestra.run.vm02.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc" 2026-03-09T18:21:17.367 INFO:teuthology.orchestra.run.vm02.stdout: ] 2026-03-09T18:21:17.367 INFO:teuthology.orchestra.run.vm02.stdout:} 2026-03-09T18:21:17.389 DEBUG:teuthology.orchestra.run.vm02:> sudo mkdir -p /etc/ceph 2026-03-09T18:21:17.419 DEBUG:teuthology.orchestra.run.vm03:> sudo mkdir -p /etc/ceph 2026-03-09T18:21:17.455 DEBUG:teuthology.orchestra.run.vm02:> sudo chmod 777 /etc/ceph 2026-03-09T18:21:17.487 DEBUG:teuthology.orchestra.run.vm03:> sudo chmod 777 /etc/ceph 2026-03-09T18:21:17.530 INFO:tasks.cephadm:Writing seed config... 2026-03-09T18:21:17.531 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-03-09T18:21:17.531 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-03-09T18:21:17.531 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = True 2026-03-09T18:21:17.531 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2026-03-09T18:21:17.531 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-03-09T18:21:17.531 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-03-09T18:21:17.531 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-03-09T18:21:17.531 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-03-09T18:21:17.531 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-03-09T18:21:17.531 INFO:tasks.cephadm: override: [osd] osd mclock iops capacity threshold hdd = 49000 2026-03-09T18:21:17.531 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-03-09T18:21:17.531 DEBUG:teuthology.orchestra.run.vm02:> set -ex 2026-03-09T18:21:17.531 DEBUG:teuthology.orchestra.run.vm02:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-03-09T18:21:17.550 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = a3515824-1be4-11f1-b292-f5e4728bca3d mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd mclock iops capacity threshold hdd = 49000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = True [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2026-03-09T18:21:17.550 DEBUG:teuthology.orchestra.run.vm02:mon.a> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mon.a.service 2026-03-09T18:21:17.592 DEBUG:teuthology.orchestra.run.vm02:mgr.y> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mgr.y.service 2026-03-09T18:21:17.635 INFO:tasks.cephadm:Bootstrapping... 2026-03-09T18:21:17.635 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df -v bootstrap --fsid a3515824-1be4-11f1-b292-f5e4728bca3d --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 192.168.123.102 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-03-09T18:21:17.786 INFO:teuthology.orchestra.run.vm02.stdout:-------------------------------------------------------------------------------- 2026-03-09T18:21:17.786 INFO:teuthology.orchestra.run.vm02.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df', '-v', 'bootstrap', '--fsid', 'a3515824-1be4-11f1-b292-f5e4728bca3d', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '192.168.123.102', '--skip-admin-label'] 2026-03-09T18:21:17.787 INFO:teuthology.orchestra.run.vm02.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-03-09T18:21:17.787 INFO:teuthology.orchestra.run.vm02.stdout:Verifying podman|docker is present... 2026-03-09T18:21:17.811 INFO:teuthology.orchestra.run.vm02.stdout:/bin/podman: stdout 5.8.0 2026-03-09T18:21:17.811 INFO:teuthology.orchestra.run.vm02.stdout:Verifying lvm2 is present... 2026-03-09T18:21:17.811 INFO:teuthology.orchestra.run.vm02.stdout:Verifying time synchronization is in place... 2026-03-09T18:21:17.819 INFO:teuthology.orchestra.run.vm02.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-03-09T18:21:17.819 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-03-09T18:21:17.826 INFO:teuthology.orchestra.run.vm02.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-03-09T18:21:17.826 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stdout inactive 2026-03-09T18:21:17.832 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stdout enabled 2026-03-09T18:21:17.839 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stdout active 2026-03-09T18:21:17.839 INFO:teuthology.orchestra.run.vm02.stdout:Unit chronyd.service is enabled and running 2026-03-09T18:21:17.839 INFO:teuthology.orchestra.run.vm02.stdout:Repeating the final host check... 2026-03-09T18:21:17.860 INFO:teuthology.orchestra.run.vm02.stdout:/bin/podman: stdout 5.8.0 2026-03-09T18:21:17.860 INFO:teuthology.orchestra.run.vm02.stdout:podman (/bin/podman) version 5.8.0 is present 2026-03-09T18:21:17.860 INFO:teuthology.orchestra.run.vm02.stdout:systemctl is present 2026-03-09T18:21:17.860 INFO:teuthology.orchestra.run.vm02.stdout:lvcreate is present 2026-03-09T18:21:17.867 INFO:teuthology.orchestra.run.vm02.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-03-09T18:21:17.868 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-03-09T18:21:17.875 INFO:teuthology.orchestra.run.vm02.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-03-09T18:21:17.875 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stdout inactive 2026-03-09T18:21:17.884 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stdout enabled 2026-03-09T18:21:17.890 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stdout active 2026-03-09T18:21:17.890 INFO:teuthology.orchestra.run.vm02.stdout:Unit chronyd.service is enabled and running 2026-03-09T18:21:17.890 INFO:teuthology.orchestra.run.vm02.stdout:Host looks OK 2026-03-09T18:21:17.890 INFO:teuthology.orchestra.run.vm02.stdout:Cluster fsid: a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:17.890 INFO:teuthology.orchestra.run.vm02.stdout:Acquiring lock 140522101643584 on /run/cephadm/a3515824-1be4-11f1-b292-f5e4728bca3d.lock 2026-03-09T18:21:17.890 INFO:teuthology.orchestra.run.vm02.stdout:Lock 140522101643584 acquired on /run/cephadm/a3515824-1be4-11f1-b292-f5e4728bca3d.lock 2026-03-09T18:21:17.890 INFO:teuthology.orchestra.run.vm02.stdout:Verifying IP 192.168.123.102 port 3300 ... 2026-03-09T18:21:17.891 INFO:teuthology.orchestra.run.vm02.stdout:Verifying IP 192.168.123.102 port 6789 ... 2026-03-09T18:21:17.891 INFO:teuthology.orchestra.run.vm02.stdout:Base mon IP(s) is [192.168.123.102:3300, 192.168.123.102:6789], mon addrv is [v2:192.168.123.102:3300,v1:192.168.123.102:6789] 2026-03-09T18:21:17.895 INFO:teuthology.orchestra.run.vm02.stdout:/sbin/ip: stdout default via 192.168.123.1 dev eth0 proto dhcp src 192.168.123.102 metric 100 2026-03-09T18:21:17.895 INFO:teuthology.orchestra.run.vm02.stdout:/sbin/ip: stdout 192.168.123.0/24 dev eth0 proto kernel scope link src 192.168.123.102 metric 100 2026-03-09T18:21:17.898 INFO:teuthology.orchestra.run.vm02.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-03-09T18:21:17.898 INFO:teuthology.orchestra.run.vm02.stdout:/sbin/ip: stdout fe80::/64 dev eth0 proto kernel metric 1024 pref medium 2026-03-09T18:21:17.901 INFO:teuthology.orchestra.run.vm02.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-03-09T18:21:17.901 INFO:teuthology.orchestra.run.vm02.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-03-09T18:21:17.901 INFO:teuthology.orchestra.run.vm02.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-03-09T18:21:17.901 INFO:teuthology.orchestra.run.vm02.stdout:/sbin/ip: stdout 2: eth0: mtu 1500 state UP qlen 1000 2026-03-09T18:21:17.901 INFO:teuthology.orchestra.run.vm02.stdout:/sbin/ip: stdout inet6 fe80::5055:ff:fe00:2/64 scope link noprefixroute 2026-03-09T18:21:17.901 INFO:teuthology.orchestra.run.vm02.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-03-09T18:21:17.902 INFO:teuthology.orchestra.run.vm02.stdout:Mon IP `192.168.123.102` is in CIDR network `192.168.123.0/24` 2026-03-09T18:21:17.902 INFO:teuthology.orchestra.run.vm02.stdout:Mon IP `192.168.123.102` is in CIDR network `192.168.123.0/24` 2026-03-09T18:21:17.902 INFO:teuthology.orchestra.run.vm02.stdout:Inferred mon public CIDR from local network configuration ['192.168.123.0/24', '192.168.123.0/24'] 2026-03-09T18:21:17.902 INFO:teuthology.orchestra.run.vm02.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-03-09T18:21:17.903 INFO:teuthology.orchestra.run.vm02.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T18:21:19.131 INFO:teuthology.orchestra.run.vm02.stdout:/bin/podman: stdout 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c 2026-03-09T18:21:19.132 INFO:teuthology.orchestra.run.vm02.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df... 2026-03-09T18:21:19.132 INFO:teuthology.orchestra.run.vm02.stdout:/bin/podman: stderr Getting image source signatures 2026-03-09T18:21:19.132 INFO:teuthology.orchestra.run.vm02.stdout:/bin/podman: stderr Copying blob sha256:1752b8d01aa0dd33bbe0ab24e8316174c94fbdcd5d26252e2680bba0624747a7 2026-03-09T18:21:19.132 INFO:teuthology.orchestra.run.vm02.stdout:/bin/podman: stderr Copying blob sha256:8e380faede39ebd4286247457b408d979ab568aafd8389c42ec304b8cfba4e92 2026-03-09T18:21:19.132 INFO:teuthology.orchestra.run.vm02.stdout:/bin/podman: stderr Copying config sha256:654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c 2026-03-09T18:21:19.132 INFO:teuthology.orchestra.run.vm02.stdout:/bin/podman: stderr Writing manifest to image destination 2026-03-09T18:21:19.409 INFO:teuthology.orchestra.run.vm02.stdout:ceph: stdout ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable) 2026-03-09T18:21:19.409 INFO:teuthology.orchestra.run.vm02.stdout:Ceph version: ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable) 2026-03-09T18:21:19.409 INFO:teuthology.orchestra.run.vm02.stdout:Extracting ceph user uid/gid from container image... 2026-03-09T18:21:19.628 INFO:teuthology.orchestra.run.vm02.stdout:stat: stdout 167 167 2026-03-09T18:21:19.628 INFO:teuthology.orchestra.run.vm02.stdout:Creating initial keys... 2026-03-09T18:21:19.866 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph-authtool: stdout AQCfD69pBDtkLBAAsZBpKk0rRxgjmbN7MZsU1Q== 2026-03-09T18:21:20.095 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph-authtool: stdout AQCfD69pJ7jMORAAyJRD4Gh7JUxVVyVKujTTSQ== 2026-03-09T18:21:20.333 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph-authtool: stdout AQCgD69pcUtZDBAAW6QdiDjT4p3yzJfuKe/Hpw== 2026-03-09T18:21:20.335 INFO:teuthology.orchestra.run.vm02.stdout:Creating initial monmap... 2026-03-09T18:21:20.580 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-03-09T18:21:20.580 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-03-09T18:21:20.580 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:20.580 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-03-09T18:21:20.580 INFO:teuthology.orchestra.run.vm02.stdout:monmaptool for a [v2:192.168.123.102:3300,v1:192.168.123.102:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-03-09T18:21:20.580 INFO:teuthology.orchestra.run.vm02.stdout:setting min_mon_release = quincy 2026-03-09T18:21:20.580 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/monmaptool: set fsid to a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:20.580 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-03-09T18:21:20.580 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:21:20.580 INFO:teuthology.orchestra.run.vm02.stdout:Creating mon... 2026-03-09T18:21:20.872 INFO:teuthology.orchestra.run.vm02.stdout:create mon.a on 2026-03-09T18:21:21.171 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-03-09T18:21:21.320 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a3515824-1be4-11f1-b292-f5e4728bca3d.target → /etc/systemd/system/ceph-a3515824-1be4-11f1-b292-f5e4728bca3d.target. 2026-03-09T18:21:21.321 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-a3515824-1be4-11f1-b292-f5e4728bca3d.target → /etc/systemd/system/ceph-a3515824-1be4-11f1-b292-f5e4728bca3d.target. 2026-03-09T18:21:21.480 INFO:teuthology.orchestra.run.vm02.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mon.a 2026-03-09T18:21:21.481 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mon.a.service: Unit ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mon.a.service not loaded. 2026-03-09T18:21:21.634 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a3515824-1be4-11f1-b292-f5e4728bca3d.target.wants/ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mon.a.service → /etc/systemd/system/ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@.service. 2026-03-09T18:21:21.835 INFO:teuthology.orchestra.run.vm02.stdout:firewalld does not appear to be present 2026-03-09T18:21:21.835 INFO:teuthology.orchestra.run.vm02.stdout:Not possible to enable service . firewalld.service is not available 2026-03-09T18:21:21.835 INFO:teuthology.orchestra.run.vm02.stdout:Waiting for mon to start... 2026-03-09T18:21:21.835 INFO:teuthology.orchestra.run.vm02.stdout:Waiting for mon... 2026-03-09T18:21:22.192 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout cluster: 2026-03-09T18:21:22.192 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout id: a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:22.192 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-03-09T18:21:22.192 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 2026-03-09T18:21:22.192 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout services: 2026-03-09T18:21:22.192 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.152775s) 2026-03-09T18:21:22.192 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-03-09T18:21:22.192 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-03-09T18:21:22.192 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 2026-03-09T18:21:22.192 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout data: 2026-03-09T18:21:22.192 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-03-09T18:21:22.193 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-03-09T18:21:22.193 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-03-09T18:21:22.193 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout pgs: 2026-03-09T18:21:22.193 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 2026-03-09T18:21:22.193 INFO:teuthology.orchestra.run.vm02.stdout:mon is available 2026-03-09T18:21:22.193 INFO:teuthology.orchestra.run.vm02.stdout:Assimilating anything we can from ceph.conf... 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout [global] 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout fsid = a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mon_host = [v2:192.168.123.102:3300,v1:192.168.123.102:6789] 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout [mgr] 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = True 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout [osd] 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-03-09T18:21:22.533 INFO:teuthology.orchestra.run.vm02.stdout:Generating new minimal ceph.conf... 2026-03-09T18:21:22.839 INFO:teuthology.orchestra.run.vm02.stdout:Restarting the monitor... 2026-03-09T18:21:23.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 podman[50371]: 2026-03-09 18:21:23.067288883 +0000 UTC m=+0.151290626 container died 69d1469dd455c0fa8afc70eb5420e028e897b51f56a2ce1993347cc6a2f5a765 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-a, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-03-09T18:21:23.448 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 podman[50371]: 2026-03-09 18:21:23.191821852 +0000 UTC m=+0.275823574 container remove 69d1469dd455c0fa8afc70eb5420e028e897b51f56a2ce1993347cc6a2f5a765 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-a, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.license=GPLv2) 2026-03-09T18:21:23.449 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 bash[50371]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-a 2026-03-09T18:21:23.449 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 systemd[1]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mon.a.service: Deactivated successfully. 2026-03-09T18:21:23.449 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 systemd[1]: Stopped Ceph mon.a for a3515824-1be4-11f1-b292-f5e4728bca3d. 2026-03-09T18:21:23.449 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 systemd[1]: Starting Ceph mon.a for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:21:23.531 INFO:teuthology.orchestra.run.vm02.stdout:Setting public_network to 192.168.123.0/24 in mon config section 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 podman[50452]: 2026-03-09 18:21:23.348295286 +0000 UTC m=+0.010137963 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 podman[50452]: 2026-03-09 18:21:23.455309429 +0000 UTC m=+0.117152096 container create 2109a366691d0a7294577d88d1725c1a9a96e9309eed7a4e5288b3ce9f76bdc4 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-a, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=squid, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS) 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 podman[50452]: 2026-03-09 18:21:23.518894176 +0000 UTC m=+0.180736852 container init 2109a366691d0a7294577d88d1725c1a9a96e9309eed7a4e5288b3ce9f76bdc4 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-a, io.buildah.version=1.41.3, CEPH_REF=squid, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 podman[50452]: 2026-03-09 18:21:23.523309227 +0000 UTC m=+0.185151894 container start 2109a366691d0a7294577d88d1725c1a9a96e9309eed7a4e5288b3ce9f76bdc4 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-a, CEPH_REF=squid, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, OSD_FLAVOR=default) 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 bash[50452]: 2109a366691d0a7294577d88d1725c1a9a96e9309eed7a4e5288b3ce9f76bdc4 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 systemd[1]: Started Ceph mon.a for a3515824-1be4-11f1-b292-f5e4728bca3d. 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: set uid:gid to 167:167 (ceph:ceph) 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable), process ceph-mon, pid 6 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: pidfile_write: ignore empty --pid-file 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: load: jerasure load: lrc 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: RocksDB version: 7.9.2 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Git sha 0 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Compile date 2026-02-25 18:11:04 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: DB SUMMARY 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: DB Session ID: RC115W9GC1GKA2WRMLWQ 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: CURRENT file: CURRENT 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: IDENTITY file: IDENTITY 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 88013 ; 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.error_if_exists: 0 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.create_if_missing: 0 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.paranoid_checks: 1 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.flush_verify_memtable_count: 1 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.env: 0x55fc2bc11dc0 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.fs: PosixFileSystem 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.info_log: 0x55fc2d3e0700 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_file_opening_threads: 16 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.statistics: (nil) 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.use_fsync: 0 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_log_file_size: 0 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.log_file_time_to_roll: 0 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.keep_log_file_num: 1000 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.recycle_log_file_num: 0 2026-03-09T18:21:23.730 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.allow_fallocate: 1 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.allow_mmap_reads: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.allow_mmap_writes: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.use_direct_reads: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.create_missing_column_families: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.db_log_dir: 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.wal_dir: 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.table_cache_numshardbits: 6 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.WAL_ttl_seconds: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.WAL_size_limit_MB: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.is_fd_close_on_exec: 1 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.advise_random_on_open: 1 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.db_write_buffer_size: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.write_buffer_manager: 0x55fc2d3e5900 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.use_adaptive_mutex: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.rate_limiter: (nil) 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.wal_recovery_mode: 2 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.enable_thread_tracking: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.enable_pipelined_write: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.unordered_write: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.row_cache: None 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.wal_filter: None 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.allow_ingest_behind: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.two_write_queues: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.manual_wal_flush: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.wal_compression: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.atomic_flush: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.persist_stats_to_disk: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.write_dbid_to_manifest: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.log_readahead_size: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.best_efforts_recovery: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.allow_data_in_errors: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.db_host_id: __hostname__ 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.enforce_single_del_contracts: true 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_background_jobs: 2 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_background_compactions: -1 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_subcompactions: 1 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.delayed_write_rate : 16777216 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_total_wal_size: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.stats_dump_period_sec: 600 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.stats_persist_period_sec: 600 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_open_files: -1 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.bytes_per_sync: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.wal_bytes_per_sync: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.strict_bytes_per_sync: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compaction_readahead_size: 0 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_background_flushes: -1 2026-03-09T18:21:23.731 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Compression algorithms supported: 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: kZSTD supported: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: kXpressCompression supported: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: kBZip2Compression supported: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: kLZ4Compression supported: 1 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: kZlibCompression supported: 1 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: kLZ4HCCompression supported: 1 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: kSnappyCompression supported: 1 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Fast CRC32 supported: Supported on x86 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: DMutex implementation: pthread_mutex_t 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.merge_operator: 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compaction_filter: None 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compaction_filter_factory: None 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.sst_partitioner_factory: None 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.memtable_factory: SkipListFactory 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.table_factory: BlockBasedTable 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fc2d3e0640) 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: cache_index_and_filter_blocks: 1 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: pin_top_level_index_and_filter: 1 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: index_type: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: data_block_index_type: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: index_shortening: 1 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: data_block_hash_table_util_ratio: 0.750000 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: checksum: 4 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: no_block_cache: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: block_cache: 0x55fc2d405350 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: block_cache_name: BinnedLRUCache 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: block_cache_options: 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: capacity : 536870912 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: num_shard_bits : 4 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: strict_capacity_limit : 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: high_pri_pool_ratio: 0.000 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: block_cache_compressed: (nil) 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: persistent_cache: (nil) 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: block_size: 4096 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: block_size_deviation: 10 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: block_restart_interval: 16 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: index_block_restart_interval: 1 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: metadata_block_size: 4096 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: partition_filters: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: use_delta_encoding: 1 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: filter_policy: bloomfilter 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: whole_key_filtering: 1 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: verify_compression: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: read_amp_bytes_per_bit: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: format_version: 5 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: enable_index_compression: 1 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: block_align: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: max_auto_readahead_size: 262144 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: prepopulate_block_cache: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: initial_auto_readahead_size: 8192 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout: num_file_reads_for_auto_readahead: 2 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.write_buffer_size: 33554432 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_write_buffer_number: 2 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compression: NoCompression 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.bottommost_compression: Disabled 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.prefix_extractor: nullptr 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.num_levels: 7 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-03-09T18:21:23.732 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compression_opts.window_bits: -14 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compression_opts.level: 32767 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compression_opts.strategy: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compression_opts.enabled: false 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.target_file_size_base: 67108864 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.target_file_size_multiplier: 1 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.arena_block_size: 1048576 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.disable_auto_compactions: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.inplace_update_support: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.inplace_update_num_locks: 10000 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.memtable_huge_page_size: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.bloom_locality: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.max_successive_merges: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.optimize_filters_for_hits: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.paranoid_file_checks: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.force_consistency_checks: 1 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.report_bg_io_stats: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.ttl: 2592000 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.periodic_compaction_seconds: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-03-09T18:21:23.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.enable_blob_files: false 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.min_blob_size: 0 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.blob_file_size: 268435456 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.blob_compression_type: NoCompression 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.enable_blob_garbage_collection: false 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.blob_file_starting_level: 0 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a721f4d7-3b7c-4737-bd98-2910d5bdecf4 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773080483551203, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773080483552947, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 84991, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 246, "table_properties": {"data_size": 83143, "index_size": 237, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10161, "raw_average_key_size": 47, "raw_value_size": 77312, "raw_average_value_size": 362, "num_data_blocks": 11, "num_entries": 213, "num_filter_entries": 213, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1773080483, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a721f4d7-3b7c-4737-bd98-2910d5bdecf4", "db_session_id": "RC115W9GC1GKA2WRMLWQ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773080483553010, "job": 1, "event": "recovery_finished"} 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fc2d406e00 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: rocksdb: DB pointer 0x55fc2d51c000 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: starting mon.a rank 0 at public addrs [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] at bind addrs [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: mon.a@-1(???) e1 preinit fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: mon.a@-1(???).mds e1 new map 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: mon.a@-1(???).mds e1 print_map 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout: e1 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout: btime 2026-03-09T18:21:21:876473+0000 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout: legacy client fscid: -1 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout: 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout: No filesystems configured 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: monmap epoch 1 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: last_changed 2026-03-09T18:21:20.441823+0000 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: created 2026-03-09T18:21:20.441823+0000 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: min_mon_release 19 (squid) 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: election_strategy: 1 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: 0: [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon.a 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: fsmap 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: osdmap e1: 0 total, 0 up, 0 in 2026-03-09T18:21:23.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:23 vm02 ceph-mon[50486]: mgrmap e1: no daemons active 2026-03-09T18:21:23.852 INFO:teuthology.orchestra.run.vm02.stdout:Wrote config to /etc/ceph/ceph.conf 2026-03-09T18:21:23.853 INFO:teuthology.orchestra.run.vm02.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-03-09T18:21:23.853 INFO:teuthology.orchestra.run.vm02.stdout:Creating mgr... 2026-03-09T18:21:23.854 INFO:teuthology.orchestra.run.vm02.stdout:Verifying port 0.0.0.0:9283 ... 2026-03-09T18:21:23.854 INFO:teuthology.orchestra.run.vm02.stdout:Verifying port 0.0.0.0:8765 ... 2026-03-09T18:21:24.022 INFO:teuthology.orchestra.run.vm02.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mgr.y 2026-03-09T18:21:24.022 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mgr.y.service: Unit ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mgr.y.service not loaded. 2026-03-09T18:21:24.163 INFO:teuthology.orchestra.run.vm02.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a3515824-1be4-11f1-b292-f5e4728bca3d.target.wants/ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mgr.y.service → /etc/systemd/system/ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@.service. 2026-03-09T18:21:24.296 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:24 vm02 systemd[1]: Starting Ceph mgr.y for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:21:24.366 INFO:teuthology.orchestra.run.vm02.stdout:firewalld does not appear to be present 2026-03-09T18:21:24.366 INFO:teuthology.orchestra.run.vm02.stdout:Not possible to enable service . firewalld.service is not available 2026-03-09T18:21:24.367 INFO:teuthology.orchestra.run.vm02.stdout:firewalld does not appear to be present 2026-03-09T18:21:24.367 INFO:teuthology.orchestra.run.vm02.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-03-09T18:21:24.367 INFO:teuthology.orchestra.run.vm02.stdout:Waiting for mgr to start... 2026-03-09T18:21:24.367 INFO:teuthology.orchestra.run.vm02.stdout:Waiting for mgr... 2026-03-09T18:21:24.584 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:24 vm02 podman[50707]: 2026-03-09 18:21:24.294486816 +0000 UTC m=+0.024673756 container create 0c51deea3849834b26195441352f2dc712d5d2522a8e7b1b75813ce569585dd5 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y, OSD_FLAVOR=default, CEPH_REF=squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True) 2026-03-09T18:21:24.584 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:24 vm02 podman[50707]: 2026-03-09 18:21:24.346636056 +0000 UTC m=+0.076823007 container init 0c51deea3849834b26195441352f2dc712d5d2522a8e7b1b75813ce569585dd5 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y, CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df) 2026-03-09T18:21:24.584 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:24 vm02 podman[50707]: 2026-03-09 18:21:24.351158865 +0000 UTC m=+0.081345805 container start 0c51deea3849834b26195441352f2dc712d5d2522a8e7b1b75813ce569585dd5 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=squid) 2026-03-09T18:21:24.584 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:24 vm02 bash[50707]: 0c51deea3849834b26195441352f2dc712d5d2522a8e7b1b75813ce569585dd5 2026-03-09T18:21:24.585 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:24 vm02 podman[50707]: 2026-03-09 18:21:24.282684941 +0000 UTC m=+0.012871890 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df 2026-03-09T18:21:24.585 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:24 vm02 systemd[1]: Started Ceph mgr.y for a3515824-1be4-11f1-b292-f5e4728bca3d. 2026-03-09T18:21:24.585 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:24 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:24.466+0000 7fab636ec140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T18:21:24.585 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:24 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:24.519+0000 7fab636ec140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout { 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "fsid": "a3515824-1be4-11f1-b292-f5e4728bca3d", 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "health": { 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 0 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout ], 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "a" 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout ], 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "btime": "2026-03-09T18:21:21:876473+0000", 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "available": false, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-09T18:21:24.728 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-09T18:21:24.729 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-09T18:21:24.729 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-09T18:21:24.729 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "restful" 2026-03-09T18:21:24.729 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout ], 2026-03-09T18:21:24.729 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T18:21:24.729 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:24.729 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-09T18:21:24.729 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T18:21:24.729 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "modified": "2026-03-09T18:21:21.877247+0000", 2026-03-09T18:21:24.729 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T18:21:24.729 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:24.729 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-09T18:21:24.729 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout } 2026-03-09T18:21:24.729 INFO:teuthology.orchestra.run.vm02.stdout:mgr not available, waiting (1/15)... 2026-03-09T18:21:24.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:24 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/468664982' entity='client.admin' 2026-03-09T18:21:24.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:24 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3008382565' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T18:21:25.348 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:24 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:24.987+0000 7fab636ec140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T18:21:25.606 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:25 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:25.346+0000 7fab636ec140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T18:21:25.606 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:25 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T18:21:25.606 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:25 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T18:21:25.606 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:25 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: from numpy import show_config as show_numpy_config 2026-03-09T18:21:25.606 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:25 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:25.446+0000 7fab636ec140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T18:21:25.606 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:25 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:25.487+0000 7fab636ec140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T18:21:25.606 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:25 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:25.563+0000 7fab636ec140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T18:21:26.417 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:26 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:26.129+0000 7fab636ec140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T18:21:26.417 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:26 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:26.251+0000 7fab636ec140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T18:21:26.417 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:26 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:26.294+0000 7fab636ec140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T18:21:26.417 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:26 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:26.329+0000 7fab636ec140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T18:21:26.417 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:26 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:26.372+0000 7fab636ec140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T18:21:26.772 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:26 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:26.415+0000 7fab636ec140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T18:21:26.773 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:26 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:26.607+0000 7fab636ec140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T18:21:26.773 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:26 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:26.663+0000 7fab636ec140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T18:21:27.039 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:27 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1099353797' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T18:21:27.039 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:26 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:26.918+0000 7fab636ec140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout { 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "fsid": "a3515824-1be4-11f1-b292-f5e4728bca3d", 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "health": { 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 0 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout ], 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "a" 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout ], 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-09T18:21:27.110 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "btime": "2026-03-09T18:21:21:876473+0000", 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "available": false, 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "restful" 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout ], 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "modified": "2026-03-09T18:21:21.877247+0000", 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout } 2026-03-09T18:21:27.111 INFO:teuthology.orchestra.run.vm02.stdout:mgr not available, waiting (2/15)... 2026-03-09T18:21:27.293 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:27 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:27.244+0000 7fab636ec140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T18:21:27.293 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:27 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:27.290+0000 7fab636ec140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T18:21:27.606 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:27 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:27.349+0000 7fab636ec140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T18:21:27.606 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:27 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:27.451+0000 7fab636ec140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T18:21:27.606 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:27 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:27.515+0000 7fab636ec140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T18:21:27.946 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:27 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:27.625+0000 7fab636ec140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T18:21:27.947 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:27 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:27.780+0000 7fab636ec140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T18:21:28.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:27 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:27.944+0000 7fab636ec140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T18:21:28.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:27 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:27.987+0000 7fab636ec140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T18:21:28.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: Activating manager daemon y 2026-03-09T18:21:28.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: mgrmap e2: y(active, starting, since 0.0056215s) 2026-03-09T18:21:28.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:21:28.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:21:28.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:21:28.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:21:28.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:21:28.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:21:28.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:21:28.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T18:21:28.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: Manager daemon y is now available 2026-03-09T18:21:28.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:21:28.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' 2026-03-09T18:21:28.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:21:28.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' 2026-03-09T18:21:28.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:28 vm02 ceph-mon[50486]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout { 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "fsid": "a3515824-1be4-11f1-b292-f5e4728bca3d", 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "health": { 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 0 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout ], 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "a" 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout ], 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-03-09T18:21:29.549 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "monmap": { 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-03-09T18:21:29.550 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "btime": "2026-03-09T18:21:21:876473+0000", 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "modules": [ 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "iostat", 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "nfs", 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "restful" 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout ], 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "modified": "2026-03-09T18:21:21.877247+0000", 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "services": {} 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout }, 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout } 2026-03-09T18:21:29.551 INFO:teuthology.orchestra.run.vm02.stdout:mgr is available 2026-03-09T18:21:29.946 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout [global] 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout fsid = a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mon_host = [v2:192.168.123.102:3300,v1:192.168.123.102:6789] 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout [mgr] 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout [osd] 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-03-09T18:21:29.947 INFO:teuthology.orchestra.run.vm02.stdout:Enabling cephadm module... 2026-03-09T18:21:30.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:29 vm02 ceph-mon[50486]: mgrmap e3: y(active, since 1.00994s) 2026-03-09T18:21:30.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:29 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1568066970' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T18:21:30.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:29 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/2159478610' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-03-09T18:21:30.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:29 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/2159478610' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-03-09T18:21:31.106 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:30 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: ignoring --setuser ceph since I am not root 2026-03-09T18:21:31.106 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:30 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: ignoring --setgroup ceph since I am not root 2026-03-09T18:21:31.106 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:30 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:30.946+0000 7fbd35aa5140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T18:21:31.106 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:31.000+0000 7fbd35aa5140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T18:21:31.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:31 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/892660914' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-03-09T18:21:31.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:31 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/892660914' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-03-09T18:21:31.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:31 vm02 ceph-mon[50486]: mgrmap e4: y(active, since 2s) 2026-03-09T18:21:31.426 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout { 2026-03-09T18:21:31.427 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "epoch": 4, 2026-03-09T18:21:31.427 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-09T18:21:31.427 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "active_name": "y", 2026-03-09T18:21:31.427 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-03-09T18:21:31.427 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout } 2026-03-09T18:21:31.427 INFO:teuthology.orchestra.run.vm02.stdout:Waiting for the mgr to restart... 2026-03-09T18:21:31.427 INFO:teuthology.orchestra.run.vm02.stdout:Waiting for mgr epoch 4... 2026-03-09T18:21:31.508 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:31.480+0000 7fbd35aa5140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T18:21:32.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:31.856+0000 7fbd35aa5140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T18:21:32.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T18:21:32.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T18:21:32.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: from numpy import show_config as show_numpy_config 2026-03-09T18:21:32.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:31.945+0000 7fbd35aa5140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T18:21:32.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:31.983+0000 7fbd35aa5140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T18:21:32.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:32 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:32.057+0000 7fbd35aa5140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T18:21:32.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:32 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1036959775' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-03-09T18:21:32.856 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:32 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:32.600+0000 7fbd35aa5140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T18:21:32.856 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:32 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:32.716+0000 7fbd35aa5140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T18:21:32.856 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:32 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:32.757+0000 7fbd35aa5140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T18:21:32.856 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:32 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:32.793+0000 7fbd35aa5140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T18:21:32.856 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:32 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:32.838+0000 7fbd35aa5140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T18:21:33.343 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:32 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:32.878+0000 7fbd35aa5140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T18:21:33.343 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:33 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:33.054+0000 7fbd35aa5140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T18:21:33.343 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:33 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:33.107+0000 7fbd35aa5140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T18:21:33.606 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:33 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:33.341+0000 7fbd35aa5140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T18:21:33.921 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:33 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:33.632+0000 7fbd35aa5140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T18:21:33.921 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:33 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:33.672+0000 7fbd35aa5140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T18:21:33.921 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:33 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:33.715+0000 7fbd35aa5140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T18:21:33.921 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:33 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:33.796+0000 7fbd35aa5140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T18:21:33.921 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:33 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:33.836+0000 7fbd35aa5140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T18:21:34.179 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:33 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:33.919+0000 7fbd35aa5140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T18:21:34.179 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:34 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:34.034+0000 7fbd35aa5140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T18:21:34.606 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:34 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:34.176+0000 7fbd35aa5140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T18:21:34.606 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:34 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:34.215+0000 7fbd35aa5140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T18:21:34.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: Active manager daemon y restarted 2026-03-09T18:21:34.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: Activating manager daemon y 2026-03-09T18:21:34.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: osdmap e2: 0 total, 0 up, 0 in 2026-03-09T18:21:34.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: mgrmap e5: y(active, starting, since 0.00481198s) 2026-03-09T18:21:34.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:21:34.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T18:21:34.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:21:34.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:21:34.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:21:34.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: Manager daemon y is now available 2026-03-09T18:21:34.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:34.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:34.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:34.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:34.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:34 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:35.517 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:35 vm02 ceph-mon[50486]: Found migration_current of "None". Setting to last migration. 2026-03-09T18:21:35.517 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:35 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:21:35.517 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:35 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:21:35.517 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:35 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:35.517 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:35 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:35.518 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:35 vm02 ceph-mon[50486]: mgrmap e6: y(active, since 1.00886s) 2026-03-09T18:21:35.520 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout { 2026-03-09T18:21:35.520 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 6, 2026-03-09T18:21:35.520 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "initialized": true 2026-03-09T18:21:35.520 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout } 2026-03-09T18:21:35.520 INFO:teuthology.orchestra.run.vm02.stdout:mgr epoch 4 is available 2026-03-09T18:21:35.520 INFO:teuthology.orchestra.run.vm02.stdout:Setting orchestrator backend to cephadm... 2026-03-09T18:21:36.293 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout value unchanged 2026-03-09T18:21:36.293 INFO:teuthology.orchestra.run.vm02.stdout:Generating ssh key... 2026-03-09T18:21:36.411 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:36 vm02 ceph-mon[50486]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-03-09T18:21:36.411 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:36 vm02 ceph-mon[50486]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-03-09T18:21:36.411 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:36 vm02 ceph-mon[50486]: [09/Mar/2026:18:21:35] ENGINE Bus STARTING 2026-03-09T18:21:36.411 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:36 vm02 ceph-mon[50486]: [09/Mar/2026:18:21:35] ENGINE Serving on http://192.168.123.102:8765 2026-03-09T18:21:36.411 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:36 vm02 ceph-mon[50486]: [09/Mar/2026:18:21:35] ENGINE Serving on https://192.168.123.102:7150 2026-03-09T18:21:36.411 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:36 vm02 ceph-mon[50486]: [09/Mar/2026:18:21:35] ENGINE Bus STARTED 2026-03-09T18:21:36.411 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:36 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:36.411 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:36 vm02 ceph-mon[50486]: [09/Mar/2026:18:21:35] ENGINE Client ('192.168.123.102', 51466) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T18:21:36.411 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:36 vm02 ceph-mon[50486]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:36.411 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:36 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:36.411 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:36 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: Generating public/private ed25519 key pair. 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: Your identification has been saved in /tmp/tmplicll_9z/key 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: Your public key has been saved in /tmp/tmplicll_9z/key.pub 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: The key fingerprint is: 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: SHA256:Id/PvF2oJ/kjSME2pzH5g90iEYrk+NgMC5vxGuazXHE ceph-a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: The key's randomart image is: 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: +--[ED25519 256]--+ 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: | | 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: | . . | 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: | +...o o | 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: | o o oo.oX . | 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: | *.BE S..% . | 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: | = +o+ =+= .. | 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: | o o. . o++. .| 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: | .+. . ++o. | 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: | oo o=o. | 2026-03-09T18:21:36.661 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:36 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: +----[SHA256]-----+ 2026-03-09T18:21:38.073 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID3peiPBwpX7Bsc+AkOyMfoqw9ltuHrDMhSTA6LhbNLq ceph-a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:38.074 INFO:teuthology.orchestra.run.vm02.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-03-09T18:21:38.074 INFO:teuthology.orchestra.run.vm02.stdout:Adding key to root@localhost authorized_keys... 2026-03-09T18:21:38.074 INFO:teuthology.orchestra.run.vm02.stdout:Adding host vm02... 2026-03-09T18:21:38.194 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:37 vm02 ceph-mon[50486]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:38.194 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:37 vm02 ceph-mon[50486]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:38.194 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:37 vm02 ceph-mon[50486]: Generating ssh key... 2026-03-09T18:21:38.194 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:37 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:38.194 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:37 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:38.194 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:37 vm02 ceph-mon[50486]: mgrmap e7: y(active, since 2s) 2026-03-09T18:21:39.039 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:38 vm02 ceph-mon[50486]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:39.040 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:38 vm02 ceph-mon[50486]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "vm02", "addr": "192.168.123.102", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:39.040 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:38 vm02 ceph-mon[50486]: Deploying cephadm binary to vm02 2026-03-09T18:21:39.987 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout Added host 'vm02' with addr '192.168.123.102' 2026-03-09T18:21:39.987 INFO:teuthology.orchestra.run.vm02.stdout:Deploying unmanaged mon service... 2026-03-09T18:21:40.428 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-03-09T18:21:40.428 INFO:teuthology.orchestra.run.vm02.stdout:Deploying unmanaged mgr service... 2026-03-09T18:21:40.853 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-03-09T18:21:40.969 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:40 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:40.970 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:40 vm02 ceph-mon[50486]: Added host vm02 2026-03-09T18:21:40.970 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:40 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:40.970 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:40 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:40.970 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:40 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:41.684 INFO:teuthology.orchestra.run.vm02.stdout:Enabling the dashboard module... 2026-03-09T18:21:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:41 vm02 ceph-mon[50486]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:41 vm02 ceph-mon[50486]: Saving service mon spec with placement count:5 2026-03-09T18:21:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:41 vm02 ceph-mon[50486]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:41 vm02 ceph-mon[50486]: Saving service mgr spec with placement count:2 2026-03-09T18:21:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:41 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/68607926' entity='client.admin' 2026-03-09T18:21:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:41 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1878117359' entity='client.admin' 2026-03-09T18:21:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:41 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:43.301 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:42 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:43.301 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:42 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/2484378172' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-03-09T18:21:43.301 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:42 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:43.301 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:42 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:43.301 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:42 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:21:43.301 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:42 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:43.301 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:42 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:21:43.301 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:42 vm02 ceph-mon[50486]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]': finished 2026-03-09T18:21:43.301 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:43 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: ignoring --setuser ceph since I am not root 2026-03-09T18:21:43.301 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:43 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: ignoring --setgroup ceph since I am not root 2026-03-09T18:21:43.301 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:43 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:43.125+0000 7f5c61b4d140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T18:21:43.301 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:43 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:43.175+0000 7f5c61b4d140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T18:21:43.639 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout { 2026-03-09T18:21:43.639 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "epoch": 8, 2026-03-09T18:21:43.639 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "available": true, 2026-03-09T18:21:43.639 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "active_name": "y", 2026-03-09T18:21:43.639 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-03-09T18:21:43.639 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout } 2026-03-09T18:21:43.639 INFO:teuthology.orchestra.run.vm02.stdout:Waiting for the mgr to restart... 2026-03-09T18:21:43.639 INFO:teuthology.orchestra.run.vm02.stdout:Waiting for mgr epoch 8... 2026-03-09T18:21:43.987 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:43 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:43.622+0000 7f5c61b4d140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T18:21:44.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:43 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:43.985+0000 7f5c61b4d140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T18:21:44.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T18:21:44.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T18:21:44.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: from numpy import show_config as show_numpy_config 2026-03-09T18:21:44.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:44.076+0000 7f5c61b4d140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T18:21:44.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:44.112+0000 7f5c61b4d140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T18:21:44.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:44.183+0000 7f5c61b4d140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T18:21:44.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:43 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/2484378172' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-03-09T18:21:44.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:43 vm02 ceph-mon[50486]: mgrmap e8: y(active, since 8s) 2026-03-09T18:21:44.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:43 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/385818288' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-03-09T18:21:44.980 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:44.697+0000 7f5c61b4d140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T18:21:44.980 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:44.819+0000 7f5c61b4d140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T18:21:44.980 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:44.860+0000 7f5c61b4d140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T18:21:44.980 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:44.897+0000 7f5c61b4d140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T18:21:44.980 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:44.938+0000 7f5c61b4d140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T18:21:45.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:44.977+0000 7f5c61b4d140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T18:21:45.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:45 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:45.161+0000 7f5c61b4d140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T18:21:45.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:45 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:45.214+0000 7f5c61b4d140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T18:21:45.730 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:45 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:45.440+0000 7f5c61b4d140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T18:21:46.019 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:45 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:45.729+0000 7f5c61b4d140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T18:21:46.019 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:45 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:45.767+0000 7f5c61b4d140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T18:21:46.019 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:45 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:45.809+0000 7f5c61b4d140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T18:21:46.019 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:45 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:45.890+0000 7f5c61b4d140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T18:21:46.019 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:45 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:45.934+0000 7f5c61b4d140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T18:21:46.274 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:46 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:46.018+0000 7f5c61b4d140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T18:21:46.274 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:46 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:46.134+0000 7f5c61b4d140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T18:21:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:46 vm02 ceph-mon[50486]: Active manager daemon y restarted 2026-03-09T18:21:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:46 vm02 ceph-mon[50486]: Activating manager daemon y 2026-03-09T18:21:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:46 vm02 ceph-mon[50486]: osdmap e3: 0 total, 0 up, 0 in 2026-03-09T18:21:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:46 vm02 ceph-mon[50486]: mgrmap e9: y(active, starting, since 0.00656723s) 2026-03-09T18:21:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:21:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T18:21:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:21:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:21:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:21:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:46 vm02 ceph-mon[50486]: Manager daemon y is now available 2026-03-09T18:21:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:46.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:21:46.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:46.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:21:46.607 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:46 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:46.273+0000 7f5c61b4d140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T18:21:46.607 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:21:46 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:21:46.310+0000 7f5c61b4d140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T18:21:47.554 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout { 2026-03-09T18:21:47.554 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 10, 2026-03-09T18:21:47.554 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout "initialized": true 2026-03-09T18:21:47.554 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout } 2026-03-09T18:21:47.554 INFO:teuthology.orchestra.run.vm02.stdout:mgr epoch 8 is available 2026-03-09T18:21:47.554 INFO:teuthology.orchestra.run.vm02.stdout:Generating a dashboard self-signed certificate... 2026-03-09T18:21:48.004 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-03-09T18:21:48.004 INFO:teuthology.orchestra.run.vm02.stdout:Creating initial admin user... 2026-03-09T18:21:48.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:47 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:48.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:47 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:21:48.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:47 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:48.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:47 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:21:48.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:47 vm02 ceph-mon[50486]: mgrmap e10: y(active, since 1.01114s) 2026-03-09T18:21:48.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:47 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:48.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:47 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:48.547 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$WusduEfqOvErO51HyS.N.u2F/VR9o7NZ8sBhmwiLuzGmApo9b9QtW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1773080508, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-03-09T18:21:48.547 INFO:teuthology.orchestra.run.vm02.stdout:Fetching dashboard port number... 2026-03-09T18:21:48.928 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stdout 8443 2026-03-09T18:21:48.928 INFO:teuthology.orchestra.run.vm02.stdout:firewalld does not appear to be present 2026-03-09T18:21:48.928 INFO:teuthology.orchestra.run.vm02.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-03-09T18:21:48.929 INFO:teuthology.orchestra.run.vm02.stdout:Ceph Dashboard is now available at: 2026-03-09T18:21:48.929 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:21:48.929 INFO:teuthology.orchestra.run.vm02.stdout: URL: https://vm02.local:8443/ 2026-03-09T18:21:48.929 INFO:teuthology.orchestra.run.vm02.stdout: User: admin 2026-03-09T18:21:48.929 INFO:teuthology.orchestra.run.vm02.stdout: Password: r3lgeanfyr 2026-03-09T18:21:48.929 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:21:48.929 INFO:teuthology.orchestra.run.vm02.stdout:Saving cluster configuration to /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config directory 2026-03-09T18:21:49.212 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:48 vm02 ceph-mon[50486]: [09/Mar/2026:18:21:47] ENGINE Bus STARTING 2026-03-09T18:21:49.212 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:48 vm02 ceph-mon[50486]: [09/Mar/2026:18:21:47] ENGINE Serving on http://192.168.123.102:8765 2026-03-09T18:21:49.212 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:48 vm02 ceph-mon[50486]: Deploying daemon agent.vm02 on vm02 2026-03-09T18:21:49.212 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:48 vm02 ceph-mon[50486]: [09/Mar/2026:18:21:47] ENGINE Serving on https://192.168.123.102:7150 2026-03-09T18:21:49.212 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:48 vm02 ceph-mon[50486]: [09/Mar/2026:18:21:47] ENGINE Bus STARTED 2026-03-09T18:21:49.212 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:48 vm02 ceph-mon[50486]: [09/Mar/2026:18:21:47] ENGINE Client ('192.168.123.102', 51628) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T18:21:49.212 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:48 vm02 ceph-mon[50486]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:49.212 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:48 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:49.212 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:48 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/2758095579' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-03-09T18:21:49.350 INFO:teuthology.orchestra.run.vm02.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout:Or, if you are only running a single cluster on this host: 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout:Please consider enabling telemetry to help improve Ceph: 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout: ceph telemetry on 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout:For more information see: 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:21:49.351 INFO:teuthology.orchestra.run.vm02.stdout:Bootstrap complete. 2026-03-09T18:21:49.390 INFO:tasks.cephadm:Fetching config... 2026-03-09T18:21:49.390 DEBUG:teuthology.orchestra.run.vm02:> set -ex 2026-03-09T18:21:49.390 DEBUG:teuthology.orchestra.run.vm02:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-03-09T18:21:49.411 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-03-09T18:21:49.412 DEBUG:teuthology.orchestra.run.vm02:> set -ex 2026-03-09T18:21:49.412 DEBUG:teuthology.orchestra.run.vm02:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-03-09T18:21:49.475 INFO:tasks.cephadm:Fetching mon keyring... 2026-03-09T18:21:49.475 DEBUG:teuthology.orchestra.run.vm02:> set -ex 2026-03-09T18:21:49.475 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/keyring of=/dev/stdout 2026-03-09T18:21:49.568 INFO:tasks.cephadm:Fetching pub ssh key... 2026-03-09T18:21:49.568 DEBUG:teuthology.orchestra.run.vm02:> set -ex 2026-03-09T18:21:49.568 DEBUG:teuthology.orchestra.run.vm02:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-03-09T18:21:49.636 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-03-09T18:21:49.637 DEBUG:teuthology.orchestra.run.vm02:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID3peiPBwpX7Bsc+AkOyMfoqw9ltuHrDMhSTA6LhbNLq ceph-a3515824-1be4-11f1-b292-f5e4728bca3d' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-03-09T18:21:49.775 INFO:teuthology.orchestra.run.vm02.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID3peiPBwpX7Bsc+AkOyMfoqw9ltuHrDMhSTA6LhbNLq ceph-a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:49.795 DEBUG:teuthology.orchestra.run.vm03:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID3peiPBwpX7Bsc+AkOyMfoqw9ltuHrDMhSTA6LhbNLq ceph-a3515824-1be4-11f1-b292-f5e4728bca3d' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-03-09T18:21:49.831 INFO:teuthology.orchestra.run.vm03.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID3peiPBwpX7Bsc+AkOyMfoqw9ltuHrDMhSTA6LhbNLq ceph-a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:49.844 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-03-09T18:21:50.153 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:21:50.193 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:50 vm02 ceph-mon[50486]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:50.193 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:50 vm02 ceph-mon[50486]: mgrmap e11: y(active, since 2s) 2026-03-09T18:21:50.193 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:50 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/49350407' entity='client.admin' 2026-03-09T18:21:50.193 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:50.193 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:50.193 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:50.193 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:50.193 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:50.193 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:50.193 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:50.193 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:50.193 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:50.193 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:50.193 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:50.663 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-03-09T18:21:50.663 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-03-09T18:21:50.929 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:21:51.410 INFO:tasks.cephadm:Writing (initial) conf and keyring to vm03 2026-03-09T18:21:51.410 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T18:21:51.410 DEBUG:teuthology.orchestra.run.vm03:> dd of=/etc/ceph/ceph.conf 2026-03-09T18:21:51.427 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T18:21:51.427 DEBUG:teuthology.orchestra.run.vm03:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:21:51.485 INFO:tasks.cephadm:Adding host vm03 to orchestrator... 2026-03-09T18:21:51.485 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch host add vm03 2026-03-09T18:21:51.554 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:51 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:51.554 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:51 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1912279715' entity='client.admin' 2026-03-09T18:21:51.554 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:51 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:51.554 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:51 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:51.554 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:51 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:51.554 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:51 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:51.554 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:51 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:51.554 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:51 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:51.554 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:51 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:21:51.554 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:51 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:21:51.814 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:21:52.443 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:52 vm02 ceph-mon[50486]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:52.443 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:52 vm02 ceph-mon[50486]: Updating vm02:/etc/ceph/ceph.conf 2026-03-09T18:21:52.443 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:52 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:52.443 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:52 vm02 ceph-mon[50486]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:21:52.443 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:52 vm02 ceph-mon[50486]: Updating vm02:/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:21:52.444 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:52 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:52.444 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:52 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:54.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:53 vm02 ceph-mon[50486]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.client.admin.keyring 2026-03-09T18:21:54.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:53 vm02 ceph-mon[50486]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "vm03", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:54.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:53 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:54.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:53 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:54.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:53 vm02 ceph-mon[50486]: Deploying cephadm binary to vm03 2026-03-09T18:21:54.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:53 vm02 ceph-mon[50486]: mgrmap e12: y(active, since 7s) 2026-03-09T18:21:54.159 INFO:teuthology.orchestra.run.vm02.stdout:Added host 'vm03' with addr '192.168.123.103' 2026-03-09T18:21:54.323 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch host ls --format=json 2026-03-09T18:21:54.520 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:21:54.796 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:21:54.796 INFO:teuthology.orchestra.run.vm02.stdout:[{"addr": "192.168.123.102", "hostname": "vm02", "labels": [], "status": ""}, {"addr": "192.168.123.103", "hostname": "vm03", "labels": [], "status": ""}] 2026-03-09T18:21:54.971 INFO:tasks.cephadm:Setting crush tunables to default 2026-03-09T18:21:54.971 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd crush tunables default 2026-03-09T18:21:55.166 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:21:55.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:55.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:55 vm02 ceph-mon[50486]: Added host vm03 2026-03-09T18:21:55.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:55.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:55.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:55.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:55.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:21:55.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:21:55.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:21:55.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:55 vm02 ceph-mon[50486]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T18:21:55.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:55 vm02 ceph-mon[50486]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:21:55.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:55 vm02 ceph-mon[50486]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T18:21:55.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:55 vm02 ceph-mon[50486]: Updating vm03:/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:21:55.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:55 vm02 ceph-mon[50486]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.client.admin.keyring 2026-03-09T18:21:56.169 INFO:teuthology.orchestra.run.vm02.stderr:adjusted tunables profile to default 2026-03-09T18:21:56.323 INFO:tasks.cephadm:Adding mon.a on vm02 2026-03-09T18:21:56.323 INFO:tasks.cephadm:Adding mon.c on vm02 2026-03-09T18:21:56.323 INFO:tasks.cephadm:Adding mon.b on vm03 2026-03-09T18:21:56.323 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch apply mon '3;vm02:192.168.123.102=a;vm02:[v2:192.168.123.102:3301,v1:192.168.123.102:6790]=c;vm03:192.168.123.103=b' 2026-03-09T18:21:56.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:56 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:56.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:56 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:56.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:56 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]: dispatch 2026-03-09T18:21:56.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:56 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]': finished 2026-03-09T18:21:56.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:56 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1040157346' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-03-09T18:21:56.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:56 vm02 ceph-mon[50486]: Deploying daemon agent.vm03 on vm03 2026-03-09T18:21:56.617 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:21:56.961 INFO:teuthology.orchestra.run.vm03.stdout:Scheduled mon update... 2026-03-09T18:21:57.146 DEBUG:teuthology.orchestra.run.vm02:mon.c> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mon.c.service 2026-03-09T18:21:57.148 DEBUG:teuthology.orchestra.run.vm03:mon.b> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mon.b.service 2026-03-09T18:21:57.151 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-03-09T18:21:57.151 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph mon dump -f json 2026-03-09T18:21:57.587 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1040157346' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:57.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:57.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;vm02:192.168.123.102=a;vm02:[v2:192.168.123.102:3301,v1:192.168.123.102:6790]=c;vm03:192.168.123.103=b", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:57.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: Saving service mon spec with placement vm02:192.168.123.102=a;vm02:[v2:192.168.123.102:3301,v1:192.168.123.102:6790]=c;vm03:192.168.123.103=b;count:3 2026-03-09T18:21:57.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:57.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:57.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:21:57.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:21:57.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:57.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T18:21:57.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:21:57.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:57 vm02 ceph-mon[50486]: Deploying daemon mon.b on vm03 2026-03-09T18:21:58.025 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T18:21:58.025 INFO:teuthology.orchestra.run.vm03.stdout:{"epoch":1,"fsid":"a3515824-1be4-11f1-b292-f5e4728bca3d","modified":"2026-03-09T18:21:20.441823Z","created":"2026-03-09T18:21:20.441823Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:3300","nonce":0},{"type":"v1","addr":"192.168.123.102:6789","nonce":0}]},"addr":"192.168.123.102:6789/0","public_addr":"192.168.123.102:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-03-09T18:21:58.025 INFO:teuthology.orchestra.run.vm03.stderr:dumped monmap epoch 1 2026-03-09T18:21:58.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:21:58 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/1024666516' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.090 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: load: jerasure load: lrc 2026-03-09T18:21:59.445 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-03-09T18:21:59.445 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph mon dump -f json 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: RocksDB version: 7.9.2 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Git sha 0 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Compile date 2026-02-25 18:11:04 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: DB SUMMARY 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: DB Session ID: 01JIZS4XHDKETV3FS2FY 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: CURRENT file: CURRENT 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: IDENTITY file: IDENTITY 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 511 ; 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.error_if_exists: 0 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.create_if_missing: 0 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.paranoid_checks: 1 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.flush_verify_memtable_count: 1 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.env: 0x5653e0e63dc0 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.fs: PosixFileSystem 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.info_log: 0x5653e2cf9880 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_file_opening_threads: 16 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.statistics: (nil) 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.use_fsync: 0 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_log_file_size: 0 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.log_file_time_to_roll: 0 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.keep_log_file_num: 1000 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.recycle_log_file_num: 0 2026-03-09T18:21:59.472 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.allow_fallocate: 1 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.allow_mmap_reads: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.allow_mmap_writes: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.use_direct_reads: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.create_missing_column_families: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.db_log_dir: 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.wal_dir: 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.table_cache_numshardbits: 6 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.WAL_ttl_seconds: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.WAL_size_limit_MB: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.is_fd_close_on_exec: 1 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.advise_random_on_open: 1 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.db_write_buffer_size: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.write_buffer_manager: 0x5653e2cfd900 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.use_adaptive_mutex: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.rate_limiter: (nil) 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.wal_recovery_mode: 2 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.enable_thread_tracking: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.enable_pipelined_write: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.unordered_write: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.row_cache: None 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.wal_filter: None 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.allow_ingest_behind: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.two_write_queues: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.manual_wal_flush: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.wal_compression: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.atomic_flush: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.persist_stats_to_disk: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.write_dbid_to_manifest: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.log_readahead_size: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.best_efforts_recovery: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.allow_data_in_errors: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.db_host_id: __hostname__ 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.enforce_single_del_contracts: true 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_background_jobs: 2 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_background_compactions: -1 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_subcompactions: 1 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-03-09T18:21:59.473 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.delayed_write_rate : 16777216 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_total_wal_size: 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.stats_dump_period_sec: 600 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.stats_persist_period_sec: 600 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_open_files: -1 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.bytes_per_sync: 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.wal_bytes_per_sync: 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.strict_bytes_per_sync: 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compaction_readahead_size: 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_background_flushes: -1 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Compression algorithms supported: 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: kZSTD supported: 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: kXpressCompression supported: 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: kBZip2Compression supported: 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: kLZ4Compression supported: 1 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: kZlibCompression supported: 1 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: kLZ4HCCompression supported: 1 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: kSnappyCompression supported: 1 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Fast CRC32 supported: Supported on x86 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: DMutex implementation: pthread_mutex_t 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.merge_operator: 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compaction_filter: None 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compaction_filter_factory: None 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.sst_partitioner_factory: None 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.memtable_factory: SkipListFactory 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.table_factory: BlockBasedTable 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5653e2cf94e0) 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: cache_index_and_filter_blocks: 1 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: pin_top_level_index_and_filter: 1 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: index_type: 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: data_block_index_type: 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: index_shortening: 1 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: data_block_hash_table_util_ratio: 0.750000 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: checksum: 4 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: no_block_cache: 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: block_cache: 0x5653e2d1c9b0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: block_cache_name: BinnedLRUCache 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: block_cache_options: 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: capacity : 536870912 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: num_shard_bits : 4 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: strict_capacity_limit : 0 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: high_pri_pool_ratio: 0.000 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: block_cache_compressed: (nil) 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: persistent_cache: (nil) 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: block_size: 4096 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: block_size_deviation: 10 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: block_restart_interval: 16 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: index_block_restart_interval: 1 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: metadata_block_size: 4096 2026-03-09T18:21:59.474 INFO:journalctl@ceph.mon.b.vm03.stdout: partition_filters: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout: use_delta_encoding: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout: filter_policy: bloomfilter 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout: whole_key_filtering: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout: verify_compression: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout: read_amp_bytes_per_bit: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout: format_version: 5 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout: enable_index_compression: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout: block_align: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout: max_auto_readahead_size: 262144 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout: prepopulate_block_cache: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout: initial_auto_readahead_size: 8192 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout: num_file_reads_for_auto_readahead: 2 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.write_buffer_size: 33554432 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_write_buffer_number: 2 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compression: NoCompression 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.bottommost_compression: Disabled 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.prefix_extractor: nullptr 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.num_levels: 7 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compression_opts.window_bits: -14 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compression_opts.level: 32767 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compression_opts.strategy: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compression_opts.enabled: false 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.target_file_size_base: 67108864 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.target_file_size_multiplier: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.arena_block_size: 1048576 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-03-09T18:21:59.475 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.disable_auto_compactions: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.inplace_update_support: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.inplace_update_num_locks: 10000 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.memtable_huge_page_size: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.bloom_locality: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.max_successive_merges: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.optimize_filters_for_hits: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.paranoid_file_checks: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.force_consistency_checks: 1 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.report_bg_io_stats: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.ttl: 2592000 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.periodic_compaction_seconds: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.enable_blob_files: false 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.min_blob_size: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.blob_file_size: 268435456 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.blob_compression_type: NoCompression 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.enable_blob_garbage_collection: false 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.blob_file_starting_level: 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 92afcb15-b772-46f6-bab8-a2468751532e 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773080519096703, "job": 1, "event": "recovery_started", "wal_files": [4]} 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773080519097383, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1643, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1773080519, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "92afcb15-b772-46f6-bab8-a2468751532e", "db_session_id": "01JIZS4XHDKETV3FS2FY", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773080519097443, "job": 1, "event": "recovery_finished"} 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5653e2d1ee00 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: DB pointer 0x5653e2e30000 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b does not exist in monmap, will attempt to join an existing cluster 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout: ** DB Stats ** 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-03-09T18:21:59.476 INFO:journalctl@ceph.mon.b.vm03.stdout: 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: ** Compaction Stats [default] ** 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: L0 1/0 1.60 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: Sum 1/0 1.60 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: ** Compaction Stats [default] ** 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: AddFile(Keys): cumulative 0, interval 0 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: Cumulative compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: Interval compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: Block cache BinnedLRUCache@0x5653e2d1c9b0#7 capacity: 512.00 MB usage: 0.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.8e-05 secs_since: 0 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: Block cache entry stats(count,size,portion): DataBlock(1,0.64 KB,0.00012219%) FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: ** File Read Latency Histogram By Level [default] ** 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: using public_addr v2:192.168.123.103:0/0 -> [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: starting mon.b rank -1 at public addrs [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] at bind addrs [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(???) e0 preinit fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).mds e1 new map 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).mds e1 print_map 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: e1 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: btime 2026-03-09T18:21:21:876473+0000 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: legacy client fscid: -1 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout: No filesystems configured 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mkfs a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: monmap epoch 1 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:59.477 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: last_changed 2026-03-09T18:21:20.441823+0000 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: created 2026-03-09T18:21:20.441823+0000 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: min_mon_release 19 (squid) 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: election_strategy: 1 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: 0: [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon.a 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: fsmap 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: osdmap e1: 0 total, 0 up, 0 in 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mgrmap e1: no daemons active 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1117354428' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/750855667' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/750855667' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3770093108' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: monmap epoch 1 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: last_changed 2026-03-09T18:21:20.441823+0000 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: created 2026-03-09T18:21:20.441823+0000 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: min_mon_release 19 (squid) 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: election_strategy: 1 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: 0: [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon.a 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: fsmap 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: osdmap e1: 0 total, 0 up, 0 in 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mgrmap e1: no daemons active 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/468664982' entity='client.admin' 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3008382565' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1099353797' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Activating manager daemon y 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mgrmap e2: y(active, starting, since 0.0056215s) 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Manager daemon y is now available 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mgrmap e3: y(active, since 1.00994s) 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1568066970' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/2159478610' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/2159478610' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/892660914' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/892660914' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mgrmap e4: y(active, since 2s) 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1036959775' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Active manager daemon y restarted 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Activating manager daemon y 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: osdmap e2: 0 total, 0 up, 0 in 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mgrmap e5: y(active, starting, since 0.00481198s) 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Manager daemon y is now available 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.478 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Found migration_current of "None". Setting to last migration. 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mgrmap e6: y(active, since 1.00886s) 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: [09/Mar/2026:18:21:35] ENGINE Bus STARTING 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: [09/Mar/2026:18:21:35] ENGINE Serving on http://192.168.123.102:8765 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: [09/Mar/2026:18:21:35] ENGINE Serving on https://192.168.123.102:7150 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: [09/Mar/2026:18:21:35] ENGINE Bus STARTED 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: [09/Mar/2026:18:21:35] ENGINE Client ('192.168.123.102', 51466) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Generating ssh key... 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mgrmap e7: y(active, since 2s) 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "vm02", "addr": "192.168.123.102", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Deploying cephadm binary to vm02 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Added host vm02 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Saving service mon spec with placement count:5 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Saving service mgr spec with placement count:2 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/68607926' entity='client.admin' 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1878117359' entity='client.admin' 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.479 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/2484378172' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]': finished 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/2484378172' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mgrmap e8: y(active, since 8s) 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/385818288' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Active manager daemon y restarted 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Activating manager daemon y 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: osdmap e3: 0 total, 0 up, 0 in 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mgrmap e9: y(active, starting, since 0.00656723s) 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Manager daemon y is now available 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mgrmap e10: y(active, since 1.01114s) 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: [09/Mar/2026:18:21:47] ENGINE Bus STARTING 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: [09/Mar/2026:18:21:47] ENGINE Serving on http://192.168.123.102:8765 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Deploying daemon agent.vm02 on vm02 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: [09/Mar/2026:18:21:47] ENGINE Serving on https://192.168.123.102:7150 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: [09/Mar/2026:18:21:47] ENGINE Bus STARTED 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: [09/Mar/2026:18:21:47] ENGINE Client ('192.168.123.102', 51628) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/2758095579' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mgrmap e11: y(active, since 2s) 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/49350407' entity='client.admin' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1912279715' entity='client.admin' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:21:59.480 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Updating vm02:/etc/ceph/ceph.conf 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Updating vm02:/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.client.admin.keyring 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "vm03", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Deploying cephadm binary to vm03 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mgrmap e12: y(active, since 7s) 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Added host vm03 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Updating vm03:/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.client.admin.keyring 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]': finished 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1040157346' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Deploying daemon agent.vm03 on vm03 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1040157346' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;vm02:192.168.123.102=a;vm02:[v2:192.168.123.102:3301,v1:192.168.123.102:6790]=c;vm03:192.168.123.103=b", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Saving service mon spec with placement vm02:192.168.123.102=a;vm02:[v2:192.168.123.102:3301,v1:192.168.123.102:6790]=c;vm03:192.168.123.103=b;count:3 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: Deploying daemon mon.b on vm03 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/1024666516' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).mgr e0 loading version 12 2026-03-09T18:21:59.481 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).mgr e12 active server: [v2:192.168.123.102:6800/1807909863,v1:192.168.123.102:6801/1807909863](14150) 2026-03-09T18:21:59.482 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:21:59 vm03 ceph-mon[54135]: mon.b@-1(synchronizing).mgr e12 mkfs or daemon transitioned to available, loading commands 2026-03-09T18:21:59.662 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:22:00.151 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 systemd[1]: Starting Ceph mon.c for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 podman[56173]: 2026-03-09 18:22:00.276116179 +0000 UTC m=+0.020633086 container create 43d0f4c6fcffab7f7d284e5fec7ec8169338c33fa080ba12658b43dece1b9e42 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-c, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, CEPH_REF=squid, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df) 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 podman[56173]: 2026-03-09 18:22:00.317626002 +0000 UTC m=+0.062142899 container init 43d0f4c6fcffab7f7d284e5fec7ec8169338c33fa080ba12658b43dece1b9e42 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=squid, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True) 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 podman[56173]: 2026-03-09 18:22:00.322621406 +0000 UTC m=+0.067138313 container start 43d0f4c6fcffab7f7d284e5fec7ec8169338c33fa080ba12658b43dece1b9e42 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-c, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, CEPH_REF=squid, OSD_FLAVOR=default, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image) 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 bash[56173]: 43d0f4c6fcffab7f7d284e5fec7ec8169338c33fa080ba12658b43dece1b9e42 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 podman[56173]: 2026-03-09 18:22:00.267605773 +0000 UTC m=+0.012122690 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 systemd[1]: Started Ceph mon.c for a3515824-1be4-11f1-b292-f5e4728bca3d. 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: set uid:gid to 167:167 (ceph:ceph) 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: ceph version 19.2.3-678-ge911bdeb (e911bdebe5c8faa3800735d1568fcdca65db60df) squid (stable), process ceph-mon, pid 7 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: pidfile_write: ignore empty --pid-file 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: load: jerasure load: lrc 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: RocksDB version: 7.9.2 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Git sha 0 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Compile date 2026-02-25 18:11:04 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: DB SUMMARY 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: DB Session ID: GB3M3I3JN1Z4A9CALGNA 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: CURRENT file: CURRENT 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: IDENTITY file: IDENTITY 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.error_if_exists: 0 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.create_if_missing: 0 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.paranoid_checks: 1 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.flush_verify_memtable_count: 1 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.env: 0x55a653a38dc0 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.fs: PosixFileSystem 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.info_log: 0x55a6560b4700 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_file_opening_threads: 16 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.statistics: (nil) 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.use_fsync: 0 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_log_file_size: 0 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-03-09T18:22:00.610 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.log_file_time_to_roll: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.keep_log_file_num: 1000 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.recycle_log_file_num: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.allow_fallocate: 1 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.allow_mmap_reads: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.allow_mmap_writes: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.use_direct_reads: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.create_missing_column_families: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.db_log_dir: 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.wal_dir: 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.table_cache_numshardbits: 6 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.WAL_ttl_seconds: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.WAL_size_limit_MB: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.is_fd_close_on_exec: 1 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.advise_random_on_open: 1 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.db_write_buffer_size: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.write_buffer_manager: 0x55a6560b9900 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.use_adaptive_mutex: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.rate_limiter: (nil) 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.wal_recovery_mode: 2 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.enable_thread_tracking: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.enable_pipelined_write: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.unordered_write: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.row_cache: None 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.wal_filter: None 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.allow_ingest_behind: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.two_write_queues: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.manual_wal_flush: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.wal_compression: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.atomic_flush: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.persist_stats_to_disk: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.write_dbid_to_manifest: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.log_readahead_size: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.best_efforts_recovery: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.allow_data_in_errors: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.db_host_id: __hostname__ 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.enforce_single_del_contracts: true 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_background_jobs: 2 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_background_compactions: -1 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_subcompactions: 1 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.delayed_write_rate : 16777216 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_total_wal_size: 0 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.stats_dump_period_sec: 600 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.stats_persist_period_sec: 600 2026-03-09T18:22:00.611 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_open_files: -1 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.bytes_per_sync: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.wal_bytes_per_sync: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.strict_bytes_per_sync: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compaction_readahead_size: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_background_flushes: -1 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Compression algorithms supported: 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: kZSTD supported: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: kXpressCompression supported: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: kBZip2Compression supported: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: kLZ4Compression supported: 1 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: kZlibCompression supported: 1 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: kLZ4HCCompression supported: 1 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: kSnappyCompression supported: 1 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Fast CRC32 supported: Supported on x86 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: DMutex implementation: pthread_mutex_t 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.merge_operator: 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compaction_filter: None 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compaction_filter_factory: None 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.sst_partitioner_factory: None 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.memtable_factory: SkipListFactory 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.table_factory: BlockBasedTable 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a6560b4640) 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: cache_index_and_filter_blocks: 1 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: pin_top_level_index_and_filter: 1 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: index_type: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: data_block_index_type: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: index_shortening: 1 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: data_block_hash_table_util_ratio: 0.750000 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: checksum: 4 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: no_block_cache: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: block_cache: 0x55a6560d9350 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: block_cache_name: BinnedLRUCache 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: block_cache_options: 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: capacity : 536870912 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: num_shard_bits : 4 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: strict_capacity_limit : 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: high_pri_pool_ratio: 0.000 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: block_cache_compressed: (nil) 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: persistent_cache: (nil) 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: block_size: 4096 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: block_size_deviation: 10 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: block_restart_interval: 16 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: index_block_restart_interval: 1 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: metadata_block_size: 4096 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: partition_filters: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: use_delta_encoding: 1 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: filter_policy: bloomfilter 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: whole_key_filtering: 1 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: verify_compression: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: read_amp_bytes_per_bit: 0 2026-03-09T18:22:00.612 INFO:journalctl@ceph.mon.c.vm02.stdout: format_version: 5 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout: enable_index_compression: 1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout: block_align: 0 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout: max_auto_readahead_size: 262144 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout: prepopulate_block_cache: 0 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout: initial_auto_readahead_size: 8192 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout: num_file_reads_for_auto_readahead: 2 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.write_buffer_size: 33554432 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_write_buffer_number: 2 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compression: NoCompression 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.bottommost_compression: Disabled 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.prefix_extractor: nullptr 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.num_levels: 7 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compression_opts.window_bits: -14 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compression_opts.level: 32767 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compression_opts.strategy: 0 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compression_opts.enabled: false 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.target_file_size_base: 67108864 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.target_file_size_multiplier: 1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.arena_block_size: 1048576 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.disable_auto_compactions: 0 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-03-09T18:22:00.613 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.inplace_update_support: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.inplace_update_num_locks: 10000 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.memtable_huge_page_size: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.bloom_locality: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.max_successive_merges: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.optimize_filters_for_hits: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.paranoid_file_checks: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.force_consistency_checks: 1 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.report_bg_io_stats: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.ttl: 2592000 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.periodic_compaction_seconds: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.enable_blob_files: false 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.min_blob_size: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.blob_file_size: 268435456 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.blob_compression_type: NoCompression 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.enable_blob_garbage_collection: false 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.blob_file_starting_level: 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2630ed32-8172-41cd-8d74-fb4e18ce0614 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773080520354693, "job": 1, "event": "recovery_started", "wal_files": [4]} 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773080520355380, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1643, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1773080520, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2630ed32-8172-41cd-8d74-fb4e18ce0614", "db_session_id": "GB3M3I3JN1Z4A9CALGNA", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: EVENT_LOG_v1 {"time_micros": 1773080520355447, "job": 1, "event": "recovery_finished"} 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a6560dae00 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: DB pointer 0x55a6561f0000 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c does not exist in monmap, will attempt to join an existing cluster 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: using public_addrv [v2:192.168.123.102:3301/0,v1:192.168.123.102:6790/0] 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: ** DB Stats ** 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: ** Compaction Stats [default] ** 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: L0 1/0 1.60 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: Sum 1/0 1.60 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: ** Compaction Stats [default] ** 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-03-09T18:22:00.614 INFO:journalctl@ceph.mon.c.vm02.stdout: 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: AddFile(Keys): cumulative 0, interval 0 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: Cumulative compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: Interval compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: Block cache BinnedLRUCache@0x55a6560d9350#7 capacity: 512.00 MB usage: 0.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: Block cache entry stats(count,size,portion): DataBlock(1,0.64 KB,0.00012219%) FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: ** File Read Latency Histogram By Level [default] ** 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: starting mon.c rank -1 at public addrs [v2:192.168.123.102:3301/0,v1:192.168.123.102:6790/0] at bind addrs [v2:192.168.123.102:3301/0,v1:192.168.123.102:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c@-1(???) e0 preinit fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c@-1(synchronizing).mds e1 new map 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c@-1(synchronizing).mds e1 print_map 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: e1 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: btime 2026-03-09T18:21:21:876473+0000 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: legacy client fscid: -1 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout: No filesystems configured 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mkfs a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: monmap epoch 1 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: last_changed 2026-03-09T18:21:20.441823+0000 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: created 2026-03-09T18:21:20.441823+0000 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: min_mon_release 19 (squid) 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: election_strategy: 1 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: 0: [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon.a 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: fsmap 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: osdmap e1: 0 total, 0 up, 0 in 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mgrmap e1: no daemons active 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1117354428' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/750855667' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/750855667' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3770093108' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.a is new leader, mons a in quorum (ranks 0) 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: monmap epoch 1 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: last_changed 2026-03-09T18:21:20.441823+0000 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: created 2026-03-09T18:21:20.441823+0000 2026-03-09T18:22:00.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: min_mon_release 19 (squid) 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: election_strategy: 1 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: 0: [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon.a 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: fsmap 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: osdmap e1: 0 total, 0 up, 0 in 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mgrmap e1: no daemons active 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/468664982' entity='client.admin' 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3008382565' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1099353797' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Activating manager daemon y 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mgrmap e2: y(active, starting, since 0.0056215s) 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Manager daemon y is now available 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14100 192.168.123.102:0/3977092769' entity='mgr.y' 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mgrmap e3: y(active, since 1.00994s) 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1568066970' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/2159478610' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/2159478610' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/892660914' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/892660914' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mgrmap e4: y(active, since 2s) 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1036959775' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Active manager daemon y restarted 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Activating manager daemon y 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: osdmap e2: 0 total, 0 up, 0 in 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mgrmap e5: y(active, starting, since 0.00481198s) 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Manager daemon y is now available 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Found migration_current of "None". Setting to last migration. 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mgrmap e6: y(active, since 1.00886s) 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: [09/Mar/2026:18:21:35] ENGINE Bus STARTING 2026-03-09T18:22:00.616 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: [09/Mar/2026:18:21:35] ENGINE Serving on http://192.168.123.102:8765 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: [09/Mar/2026:18:21:35] ENGINE Serving on https://192.168.123.102:7150 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: [09/Mar/2026:18:21:35] ENGINE Bus STARTED 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: [09/Mar/2026:18:21:35] ENGINE Client ('192.168.123.102', 51466) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Generating ssh key... 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mgrmap e7: y(active, since 2s) 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "vm02", "addr": "192.168.123.102", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Deploying cephadm binary to vm02 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Added host vm02 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Saving service mon spec with placement count:5 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Saving service mgr spec with placement count:2 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/68607926' entity='client.admin' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1878117359' entity='client.admin' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/2484378172' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14118 192.168.123.102:0/2819021874' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]': finished 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/2484378172' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mgrmap e8: y(active, since 8s) 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/385818288' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Active manager daemon y restarted 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Activating manager daemon y 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: osdmap e3: 0 total, 0 up, 0 in 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mgrmap e9: y(active, starting, since 0.00656723s) 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Manager daemon y is now available 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.617 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mgrmap e10: y(active, since 1.01114s) 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: [09/Mar/2026:18:21:47] ENGINE Bus STARTING 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: [09/Mar/2026:18:21:47] ENGINE Serving on http://192.168.123.102:8765 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Deploying daemon agent.vm02 on vm02 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: [09/Mar/2026:18:21:47] ENGINE Serving on https://192.168.123.102:7150 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: [09/Mar/2026:18:21:47] ENGINE Bus STARTED 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: [09/Mar/2026:18:21:47] ENGINE Client ('192.168.123.102', 51628) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/2758095579' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mgrmap e11: y(active, since 2s) 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/49350407' entity='client.admin' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1912279715' entity='client.admin' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Updating vm02:/etc/ceph/ceph.conf 2026-03-09T18:22:00.618 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Updating vm02:/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.client.admin.keyring 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "vm03", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Deploying cephadm binary to vm03 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mgrmap e12: y(active, since 7s) 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Added host vm03 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Updating vm03:/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.client.admin.keyring 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]': finished 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1040157346' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Deploying daemon agent.vm03 on vm03 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1040157346' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;vm02:192.168.123.102=a;vm02:[v2:192.168.123.102:3301,v1:192.168.123.102:6790]=c;vm03:192.168.123.103=b", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Saving service mon spec with placement vm02:192.168.123.102=a;vm02:[v2:192.168.123.102:3301,v1:192.168.123.102:6790]=c;vm03:192.168.123.103=b;count:3 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: Deploying daemon mon.b on vm03 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/1024666516' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T18:22:00.619 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:00 vm02 ceph-mon[56210]: mon.c@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: Deploying daemon mon.c on vm02 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: mon.a calling monitor election 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: mon.b calling monitor election 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: monmap epoch 2 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: last_changed 2026-03-09T18:21:59.131316+0000 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: created 2026-03-09T18:21:20.441823+0000 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: min_mon_release 19 (squid) 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: election_strategy: 1 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: 0: [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon.a 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: 1: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.b 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: fsmap 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: mgrmap e12: y(active, since 17s) 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: overall HEALTH_OK 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: Deploying daemon mon.c on vm02 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: mon.a calling monitor election 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: mon.b calling monitor election 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: monmap epoch 2 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: last_changed 2026-03-09T18:21:59.131316+0000 2026-03-09T18:22:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: created 2026-03-09T18:21:20.441823+0000 2026-03-09T18:22:04.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: min_mon_release 19 (squid) 2026-03-09T18:22:04.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: election_strategy: 1 2026-03-09T18:22:04.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: 0: [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon.a 2026-03-09T18:22:04.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: 1: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.b 2026-03-09T18:22:04.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: fsmap 2026-03-09T18:22:04.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T18:22:04.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: mgrmap e12: y(active, since 17s) 2026-03-09T18:22:04.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: overall HEALTH_OK 2026-03-09T18:22:04.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:04.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:04.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:04.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:04.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:04.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:05.578 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:22:05 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:22:05.130+0000 7f5c2deb6640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-03-09T18:22:09.415 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T18:22:09.415 INFO:teuthology.orchestra.run.vm03.stdout:{"epoch":3,"fsid":"a3515824-1be4-11f1-b292-f5e4728bca3d","modified":"2026-03-09T18:22:04.391758Z","created":"2026-03-09T18:21:20.441823Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:3300","nonce":0},{"type":"v1","addr":"192.168.123.102:6789","nonce":0}]},"addr":"192.168.123.102:6789/0","public_addr":"192.168.123.102:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:3300","nonce":0},{"type":"v1","addr":"192.168.123.103:6789","nonce":0}]},"addr":"192.168.123.103:6789/0","public_addr":"192.168.123.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:3301","nonce":0},{"type":"v1","addr":"192.168.123.102:6790","nonce":0}]},"addr":"192.168.123.102:6790/0","public_addr":"192.168.123.102:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2026-03-09T18:22:09.415 INFO:teuthology.orchestra.run.vm03.stderr:dumped monmap epoch 3 2026-03-09T18:22:09.614 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-03-09T18:22:09.614 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph config generate-minimal-conf 2026-03-09T18:22:09.733 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: Updating vm02:/etc/ceph/ceph.conf 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: mon.b calling monitor election 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: mon.a calling monitor election 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/877724469' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: monmap epoch 3 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: last_changed 2026-03-09T18:22:04.391758+0000 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: created 2026-03-09T18:21:20.441823+0000 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: min_mon_release 19 (squid) 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: election_strategy: 1 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: 0: [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon.a 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: 1: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.b 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: 2: [v2:192.168.123.102:3301/0,v1:192.168.123.102:6790/0] mon.c 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: fsmap 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: mgrmap e12: y(active, since 23s) 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: overall HEALTH_OK 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.734 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.735 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: Updating vm02:/etc/ceph/ceph.conf 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: mon.b calling monitor election 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: mon.a calling monitor election 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/877724469' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:09.754 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: monmap epoch 3 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: last_changed 2026-03-09T18:22:04.391758+0000 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: created 2026-03-09T18:21:20.441823+0000 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: min_mon_release 19 (squid) 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: election_strategy: 1 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: 0: [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon.a 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: 1: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.b 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: 2: [v2:192.168.123.102:3301/0,v1:192.168.123.102:6790/0] mon.c 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: fsmap 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: mgrmap e12: y(active, since 23s) 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: overall HEALTH_OK 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.755 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:09.981 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:22:10.269 INFO:teuthology.orchestra.run.vm02.stdout:# minimal ceph.conf for a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:10.269 INFO:teuthology.orchestra.run.vm02.stdout:[global] 2026-03-09T18:22:10.269 INFO:teuthology.orchestra.run.vm02.stdout: fsid = a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:10.269 INFO:teuthology.orchestra.run.vm02.stdout: mon_host = [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] [v2:192.168.123.102:3301/0,v1:192.168.123.102:6790/0] 2026-03-09T18:22:10.469 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-03-09T18:22:10.470 DEBUG:teuthology.orchestra.run.vm02:> set -ex 2026-03-09T18:22:10.470 DEBUG:teuthology.orchestra.run.vm02:> sudo dd of=/etc/ceph/ceph.conf 2026-03-09T18:22:10.503 DEBUG:teuthology.orchestra.run.vm02:> set -ex 2026-03-09T18:22:10.503 DEBUG:teuthology.orchestra.run.vm02:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:22:10.572 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.572 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.572 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: Reconfiguring mon.a (unknown last config time)... 2026-03-09T18:22:10.572 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: Reconfiguring daemon mon.a on vm02 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1472197164' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:10.573 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:10 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:10.576 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T18:22:10.576 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/etc/ceph/ceph.conf 2026-03-09T18:22:10.608 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T18:22:10.608 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:22:10.684 INFO:tasks.cephadm:Adding mgr.y on vm02 2026-03-09T18:22:10.684 INFO:tasks.cephadm:Adding mgr.x on vm03 2026-03-09T18:22:10.684 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch apply mgr '2;vm02=y;vm03=x' 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: Reconfiguring mon.a (unknown last config time)... 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: Reconfiguring daemon mon.a on vm02 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1472197164' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:10.751 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:10 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:11.114 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:22:11.450 INFO:teuthology.orchestra.run.vm03.stdout:Scheduled mgr update... 2026-03-09T18:22:11.615 DEBUG:teuthology.orchestra.run.vm03:mgr.x> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mgr.x.service 2026-03-09T18:22:11.659 INFO:tasks.cephadm:Deploying OSDs... 2026-03-09T18:22:11.659 DEBUG:teuthology.orchestra.run.vm02:> set -ex 2026-03-09T18:22:11.659 DEBUG:teuthology.orchestra.run.vm02:> dd if=/scratch_devs of=/dev/stdout 2026-03-09T18:22:11.676 DEBUG:teuthology.misc:devs=['/dev/nvme0n1', '/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1'] 2026-03-09T18:22:11.676 DEBUG:teuthology.orchestra.run.vm02:> stat /dev/nvme0n1 2026-03-09T18:22:11.736 INFO:teuthology.orchestra.run.vm02.stdout: File: /dev/nvme0n1 2026-03-09T18:22:11.736 INFO:teuthology.orchestra.run.vm02.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:22:11.736 INFO:teuthology.orchestra.run.vm02.stdout:Device: 6h/6d Inode: 729 Links: 1 Device type: 103,1 2026-03-09T18:22:11.737 INFO:teuthology.orchestra.run.vm02.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:22:11.737 INFO:teuthology.orchestra.run.vm02.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:22:11.737 INFO:teuthology.orchestra.run.vm02.stdout:Access: 2026-03-09 18:22:07.046037689 +0000 2026-03-09T18:22:11.737 INFO:teuthology.orchestra.run.vm02.stdout:Modify: 2026-03-09 18:20:17.891165006 +0000 2026-03-09T18:22:11.737 INFO:teuthology.orchestra.run.vm02.stdout:Change: 2026-03-09 18:20:17.891165006 +0000 2026-03-09T18:22:11.737 INFO:teuthology.orchestra.run.vm02.stdout: Birth: 2026-03-09 18:20:17.046865593 +0000 2026-03-09T18:22:11.737 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/nvme0n1 of=/dev/null count=1 2026-03-09T18:22:11.803 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: Deploying daemon mon.c on vm02 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: mon.a calling monitor election 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: mon.b calling monitor election 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: monmap epoch 2 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: last_changed 2026-03-09T18:21:59.131316+0000 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: created 2026-03-09T18:21:20.441823+0000 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: min_mon_release 19 (squid) 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: election_strategy: 1 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: 0: [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon.a 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: 1: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.b 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: fsmap 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: mgrmap e12: y(active, since 17s) 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: overall HEALTH_OK 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: Updating vm02:/etc/ceph/ceph.conf 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: mon.b calling monitor election 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: mon.a calling monitor election 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/877724469' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: monmap epoch 3 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: last_changed 2026-03-09T18:22:04.391758+0000 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: created 2026-03-09T18:21:20.441823+0000 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: min_mon_release 19 (squid) 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: election_strategy: 1 2026-03-09T18:22:11.804 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: 0: [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon.a 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: 1: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.b 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: 2: [v2:192.168.123.102:3301/0,v1:192.168.123.102:6790/0] mon.c 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: fsmap 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: mgrmap e12: y(active, since 23s) 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: overall HEALTH_OK 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: Reconfiguring mon.a (unknown last config time)... 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: Reconfiguring daemon mon.a on vm02 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1472197164' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:11.805 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:11.806 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records in 2026-03-09T18:22:11.806 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records out 2026-03-09T18:22:11.806 INFO:teuthology.orchestra.run.vm02.stderr:512 bytes copied, 0.000193783 s, 2.6 MB/s 2026-03-09T18:22:11.807 DEBUG:teuthology.orchestra.run.vm02:> ! mount | grep -v devtmpfs | grep -q /dev/nvme0n1 2026-03-09T18:22:11.869 DEBUG:teuthology.orchestra.run.vm02:> stat /dev/nvme1n1 2026-03-09T18:22:11.928 INFO:teuthology.orchestra.run.vm02.stdout: File: /dev/nvme1n1 2026-03-09T18:22:11.928 INFO:teuthology.orchestra.run.vm02.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:22:11.928 INFO:teuthology.orchestra.run.vm02.stdout:Device: 6h/6d Inode: 740 Links: 1 Device type: 103,2 2026-03-09T18:22:11.928 INFO:teuthology.orchestra.run.vm02.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:22:11.928 INFO:teuthology.orchestra.run.vm02.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:22:11.928 INFO:teuthology.orchestra.run.vm02.stdout:Access: 2026-03-09 18:22:07.050037696 +0000 2026-03-09T18:22:11.928 INFO:teuthology.orchestra.run.vm02.stdout:Modify: 2026-03-09 18:20:18.331911319 +0000 2026-03-09T18:22:11.928 INFO:teuthology.orchestra.run.vm02.stdout:Change: 2026-03-09 18:20:18.331911319 +0000 2026-03-09T18:22:11.928 INFO:teuthology.orchestra.run.vm02.stdout: Birth: 2026-03-09 18:20:17.152652517 +0000 2026-03-09T18:22:11.928 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/nvme1n1 of=/dev/null count=1 2026-03-09T18:22:11.997 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records in 2026-03-09T18:22:11.997 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records out 2026-03-09T18:22:11.997 INFO:teuthology.orchestra.run.vm02.stderr:512 bytes copied, 0.000286577 s, 1.8 MB/s 2026-03-09T18:22:11.998 DEBUG:teuthology.orchestra.run.vm02:> ! mount | grep -v devtmpfs | grep -q /dev/nvme1n1 2026-03-09T18:22:12.056 DEBUG:teuthology.orchestra.run.vm02:> stat /dev/nvme2n1 2026-03-09T18:22:12.116 INFO:teuthology.orchestra.run.vm02.stdout: File: /dev/nvme2n1 2026-03-09T18:22:12.116 INFO:teuthology.orchestra.run.vm02.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:22:12.116 INFO:teuthology.orchestra.run.vm02.stdout:Device: 6h/6d Inode: 753 Links: 1 Device type: 103,5 2026-03-09T18:22:12.116 INFO:teuthology.orchestra.run.vm02.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:22:12.116 INFO:teuthology.orchestra.run.vm02.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:22:12.116 INFO:teuthology.orchestra.run.vm02.stdout:Access: 2026-03-09 18:22:07.055037704 +0000 2026-03-09T18:22:12.116 INFO:teuthology.orchestra.run.vm02.stdout:Modify: 2026-03-09 18:20:18.779914029 +0000 2026-03-09T18:22:12.116 INFO:teuthology.orchestra.run.vm02.stdout:Change: 2026-03-09 18:20:18.779914029 +0000 2026-03-09T18:22:12.116 INFO:teuthology.orchestra.run.vm02.stdout: Birth: 2026-03-09 18:20:17.315324862 +0000 2026-03-09T18:22:12.116 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/nvme2n1 of=/dev/null count=1 2026-03-09T18:22:12.193 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records in 2026-03-09T18:22:12.194 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records out 2026-03-09T18:22:12.194 INFO:teuthology.orchestra.run.vm02.stderr:512 bytes copied, 0.000167333 s, 3.1 MB/s 2026-03-09T18:22:12.195 DEBUG:teuthology.orchestra.run.vm02:> ! mount | grep -v devtmpfs | grep -q /dev/nvme2n1 2026-03-09T18:22:12.253 DEBUG:teuthology.orchestra.run.vm02:> stat /dev/nvme3n1 2026-03-09T18:22:12.312 INFO:teuthology.orchestra.run.vm02.stdout: File: /dev/nvme3n1 2026-03-09T18:22:12.313 INFO:teuthology.orchestra.run.vm02.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:22:12.313 INFO:teuthology.orchestra.run.vm02.stdout:Device: 6h/6d Inode: 765 Links: 1 Device type: 103,7 2026-03-09T18:22:12.313 INFO:teuthology.orchestra.run.vm02.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:22:12.313 INFO:teuthology.orchestra.run.vm02.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:22:12.313 INFO:teuthology.orchestra.run.vm02.stdout:Access: 2026-03-09 18:22:07.059037711 +0000 2026-03-09T18:22:12.313 INFO:teuthology.orchestra.run.vm02.stdout:Modify: 2026-03-09 18:20:19.236915651 +0000 2026-03-09T18:22:12.313 INFO:teuthology.orchestra.run.vm02.stdout:Change: 2026-03-09 18:20:19.236915651 +0000 2026-03-09T18:22:12.313 INFO:teuthology.orchestra.run.vm02.stdout: Birth: 2026-03-09 18:20:17.422109776 +0000 2026-03-09T18:22:12.313 DEBUG:teuthology.orchestra.run.vm02:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2026-03-09T18:22:12.380 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records in 2026-03-09T18:22:12.380 INFO:teuthology.orchestra.run.vm02.stderr:1+0 records out 2026-03-09T18:22:12.380 INFO:teuthology.orchestra.run.vm02.stderr:512 bytes copied, 0.000210074 s, 2.4 MB/s 2026-03-09T18:22:12.382 DEBUG:teuthology.orchestra.run.vm02:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: mon.c calling monitor election 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: Updating vm02:/etc/ceph/ceph.conf 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: mon.c calling monitor election 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: mon.a calling monitor election 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: mon.b calling monitor election 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: monmap epoch 3 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: last_changed 2026-03-09T18:22:04.391758+0000 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: created 2026-03-09T18:21:20.441823+0000 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: min_mon_release 19 (squid) 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: election_strategy: 1 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: 0: [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon.a 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: 1: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.b 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: 2: [v2:192.168.123.102:3301/0,v1:192.168.123.102:6790/0] mon.c 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: fsmap 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T18:22:12.406 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: mgrmap e12: y(active, since 25s) 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: overall HEALTH_OK 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;vm02=y;vm03=x", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: Saving service mgr spec with placement vm02=y;vm03=x;count:2 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:12 vm03 ceph-mon[54135]: Deploying daemon mgr.x on vm03 2026-03-09T18:22:12.407 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:12 vm03 systemd[1]: Starting Ceph mgr.x for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:22:12.441 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T18:22:12.441 DEBUG:teuthology.orchestra.run.vm03:> dd if=/scratch_devs of=/dev/stdout 2026-03-09T18:22:12.469 DEBUG:teuthology.misc:devs=['/dev/nvme0n1', '/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1'] 2026-03-09T18:22:12.469 DEBUG:teuthology.orchestra.run.vm03:> stat /dev/nvme0n1 2026-03-09T18:22:12.541 INFO:teuthology.orchestra.run.vm03.stdout: File: /dev/nvme0n1 2026-03-09T18:22:12.541 INFO:teuthology.orchestra.run.vm03.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:22:12.541 INFO:teuthology.orchestra.run.vm03.stdout:Device: 6h/6d Inode: 729 Links: 1 Device type: 103,1 2026-03-09T18:22:12.541 INFO:teuthology.orchestra.run.vm03.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:22:12.541 INFO:teuthology.orchestra.run.vm03.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:22:12.541 INFO:teuthology.orchestra.run.vm03.stdout:Access: 2026-03-09 18:22:06.170924909 +0000 2026-03-09T18:22:12.541 INFO:teuthology.orchestra.run.vm03.stdout:Modify: 2026-03-09 18:20:21.533913529 +0000 2026-03-09T18:22:12.541 INFO:teuthology.orchestra.run.vm03.stdout:Change: 2026-03-09 18:20:21.533913529 +0000 2026-03-09T18:22:12.541 INFO:teuthology.orchestra.run.vm03.stdout: Birth: 2026-03-09 18:20:20.588917385 +0000 2026-03-09T18:22:12.542 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/nvme0n1 of=/dev/null count=1 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: mon.c calling monitor election 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: Updating vm02:/etc/ceph/ceph.conf 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: mon.c calling monitor election 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: mon.a calling monitor election 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: mon.b calling monitor election 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: monmap epoch 3 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: last_changed 2026-03-09T18:22:04.391758+0000 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: created 2026-03-09T18:21:20.441823+0000 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: min_mon_release 19 (squid) 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: election_strategy: 1 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: 0: [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon.a 2026-03-09T18:22:12.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: 1: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.b 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: 2: [v2:192.168.123.102:3301/0,v1:192.168.123.102:6790/0] mon.c 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: fsmap 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: mgrmap e12: y(active, since 25s) 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: overall HEALTH_OK 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;vm02=y;vm03=x", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: Saving service mgr spec with placement vm02=y;vm03=x;count:2 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[50486]: Deploying daemon mgr.x on vm03 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: mon.c calling monitor election 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: Updating vm02:/etc/ceph/ceph.conf 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: mon.c calling monitor election 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: mon.a calling monitor election 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: mon.b calling monitor election 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: monmap epoch 3 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: fsid a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: last_changed 2026-03-09T18:22:04.391758+0000 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: created 2026-03-09T18:21:20.441823+0000 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: min_mon_release 19 (squid) 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: election_strategy: 1 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: 0: [v2:192.168.123.102:3300/0,v1:192.168.123.102:6789/0] mon.a 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: 1: [v2:192.168.123.103:3300/0,v1:192.168.123.103:6789/0] mon.b 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: 2: [v2:192.168.123.102:3301/0,v1:192.168.123.102:6790/0] mon.c 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: fsmap 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: osdmap e4: 0 total, 0 up, 0 in 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: mgrmap e12: y(active, since 25s) 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: overall HEALTH_OK 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;vm02=y;vm03=x", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: Saving service mgr spec with placement vm02=y;vm03=x;count:2 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:12.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:12 vm02 ceph-mon[56210]: Deploying daemon mgr.x on vm03 2026-03-09T18:22:12.626 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records in 2026-03-09T18:22:12.626 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records out 2026-03-09T18:22:12.626 INFO:teuthology.orchestra.run.vm03.stderr:512 bytes copied, 0.000180387 s, 2.8 MB/s 2026-03-09T18:22:12.627 DEBUG:teuthology.orchestra.run.vm03:> ! mount | grep -v devtmpfs | grep -q /dev/nvme0n1 2026-03-09T18:22:12.677 DEBUG:teuthology.orchestra.run.vm03:> stat /dev/nvme1n1 2026-03-09T18:22:12.703 INFO:teuthology.orchestra.run.vm03.stdout: File: /dev/nvme1n1 2026-03-09T18:22:12.703 INFO:teuthology.orchestra.run.vm03.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:22:12.703 INFO:teuthology.orchestra.run.vm03.stdout:Device: 6h/6d Inode: 741 Links: 1 Device type: 103,3 2026-03-09T18:22:12.703 INFO:teuthology.orchestra.run.vm03.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:22:12.703 INFO:teuthology.orchestra.run.vm03.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:22:12.703 INFO:teuthology.orchestra.run.vm03.stdout:Access: 2026-03-09 18:22:06.175924919 +0000 2026-03-09T18:22:12.703 INFO:teuthology.orchestra.run.vm03.stdout:Modify: 2026-03-09 18:20:22.005911603 +0000 2026-03-09T18:22:12.703 INFO:teuthology.orchestra.run.vm03.stdout:Change: 2026-03-09 18:20:22.005911603 +0000 2026-03-09T18:22:12.703 INFO:teuthology.orchestra.run.vm03.stdout: Birth: 2026-03-09 18:20:20.744916748 +0000 2026-03-09T18:22:12.703 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/nvme1n1 of=/dev/null count=1 2026-03-09T18:22:12.735 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:12 vm03 podman[56190]: 2026-03-09 18:22:12.534058578 +0000 UTC m=+0.021305899 container create 2539500ee64d85dd098fc5d398ef3e449995e1e0fe33eabd39d0fce274a568d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_REF=squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, OSD_FLAVOR=default) 2026-03-09T18:22:12.735 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:12 vm03 podman[56190]: 2026-03-09 18:22:12.594970847 +0000 UTC m=+0.082218178 container init 2539500ee64d85dd098fc5d398ef3e449995e1e0fe33eabd39d0fce274a568d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_REF=squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223) 2026-03-09T18:22:12.735 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:12 vm03 podman[56190]: 2026-03-09 18:22:12.613067266 +0000 UTC m=+0.100314587 container start 2539500ee64d85dd098fc5d398ef3e449995e1e0fe33eabd39d0fce274a568d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, CEPH_REF=squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default) 2026-03-09T18:22:12.735 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:12 vm03 bash[56190]: 2539500ee64d85dd098fc5d398ef3e449995e1e0fe33eabd39d0fce274a568d1 2026-03-09T18:22:12.735 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:12 vm03 podman[56190]: 2026-03-09 18:22:12.526139369 +0000 UTC m=+0.013386699 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T18:22:12.735 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:12 vm03 systemd[1]: Started Ceph mgr.x for a3515824-1be4-11f1-b292-f5e4728bca3d. 2026-03-09T18:22:12.735 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:12.732+0000 7f4b06215140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T18:22:12.770 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records in 2026-03-09T18:22:12.770 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records out 2026-03-09T18:22:12.770 INFO:teuthology.orchestra.run.vm03.stderr:512 bytes copied, 0.000205876 s, 2.5 MB/s 2026-03-09T18:22:12.771 DEBUG:teuthology.orchestra.run.vm03:> ! mount | grep -v devtmpfs | grep -q /dev/nvme1n1 2026-03-09T18:22:12.846 DEBUG:teuthology.orchestra.run.vm03:> stat /dev/nvme2n1 2026-03-09T18:22:12.909 INFO:teuthology.orchestra.run.vm03.stdout: File: /dev/nvme2n1 2026-03-09T18:22:12.910 INFO:teuthology.orchestra.run.vm03.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:22:12.910 INFO:teuthology.orchestra.run.vm03.stdout:Device: 6h/6d Inode: 753 Links: 1 Device type: 103,5 2026-03-09T18:22:12.910 INFO:teuthology.orchestra.run.vm03.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:22:12.910 INFO:teuthology.orchestra.run.vm03.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:22:12.910 INFO:teuthology.orchestra.run.vm03.stdout:Access: 2026-03-09 18:22:06.180924929 +0000 2026-03-09T18:22:12.910 INFO:teuthology.orchestra.run.vm03.stdout:Modify: 2026-03-09 18:20:22.480909665 +0000 2026-03-09T18:22:12.910 INFO:teuthology.orchestra.run.vm03.stdout:Change: 2026-03-09 18:20:22.480909665 +0000 2026-03-09T18:22:12.910 INFO:teuthology.orchestra.run.vm03.stdout: Birth: 2026-03-09 18:20:20.915916051 +0000 2026-03-09T18:22:12.910 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/nvme2n1 of=/dev/null count=1 2026-03-09T18:22:12.978 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records in 2026-03-09T18:22:12.979 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records out 2026-03-09T18:22:12.979 INFO:teuthology.orchestra.run.vm03.stderr:512 bytes copied, 0.000238046 s, 2.2 MB/s 2026-03-09T18:22:12.979 DEBUG:teuthology.orchestra.run.vm03:> ! mount | grep -v devtmpfs | grep -q /dev/nvme2n1 2026-03-09T18:22:13.003 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:12.787+0000 7f4b06215140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T18:22:13.032 DEBUG:teuthology.orchestra.run.vm03:> stat /dev/nvme3n1 2026-03-09T18:22:13.106 INFO:teuthology.orchestra.run.vm03.stdout: File: /dev/nvme3n1 2026-03-09T18:22:13.106 INFO:teuthology.orchestra.run.vm03.stdout: Size: 0 Blocks: 0 IO Block: 512 block special file 2026-03-09T18:22:13.106 INFO:teuthology.orchestra.run.vm03.stdout:Device: 6h/6d Inode: 763 Links: 1 Device type: 103,7 2026-03-09T18:22:13.106 INFO:teuthology.orchestra.run.vm03.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-03-09T18:22:13.106 INFO:teuthology.orchestra.run.vm03.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-03-09T18:22:13.106 INFO:teuthology.orchestra.run.vm03.stdout:Access: 2026-03-09 18:22:06.183924935 +0000 2026-03-09T18:22:13.106 INFO:teuthology.orchestra.run.vm03.stdout:Modify: 2026-03-09 18:20:22.961907703 +0000 2026-03-09T18:22:13.106 INFO:teuthology.orchestra.run.vm03.stdout:Change: 2026-03-09 18:20:22.961907703 +0000 2026-03-09T18:22:13.106 INFO:teuthology.orchestra.run.vm03.stdout: Birth: 2026-03-09 18:20:21.040915541 +0000 2026-03-09T18:22:13.106 DEBUG:teuthology.orchestra.run.vm03:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2026-03-09T18:22:13.193 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records in 2026-03-09T18:22:13.193 INFO:teuthology.orchestra.run.vm03.stderr:1+0 records out 2026-03-09T18:22:13.193 INFO:teuthology.orchestra.run.vm03.stderr:512 bytes copied, 0.000308338 s, 1.7 MB/s 2026-03-09T18:22:13.194 DEBUG:teuthology.orchestra.run.vm03:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2026-03-09T18:22:13.219 INFO:tasks.cephadm:Deploying osd.0 on vm02 with /dev/nvme3n1... 2026-03-09T18:22:13.219 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- lvm zap /dev/nvme3n1 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: Reconfiguring mgr.y (unknown last config time)... 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:13.339 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:13 vm03 ceph-mon[54135]: Reconfiguring daemon mgr.y on vm02 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: Reconfiguring mgr.y (unknown last config time)... 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T18:22:13.358 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[50486]: Reconfiguring daemon mgr.y on vm02 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: Reconfiguring mgr.y (unknown last config time)... 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:13.359 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:13 vm02 ceph-mon[56210]: Reconfiguring daemon mgr.y on vm02 2026-03-09T18:22:13.444 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:22:13.660 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:22:13 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:22:13.389+0000 7f5c2deb6640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-03-09T18:22:13.753 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:13 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:13.436+0000 7f4b06215140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T18:22:14.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[56210]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[50486]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:14.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:14 vm03 ceph-mon[54135]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:14 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:14.136+0000 7f4b06215140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:14 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:14 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:14 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: from numpy import show_config as show_numpy_config 2026-03-09T18:22:14.444 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:14 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:14.319+0000 7f4b06215140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T18:22:14.445 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:14 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:14.367+0000 7f4b06215140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T18:22:14.639 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:22:14.669 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch daemon add osd vm02:/dev/nvme3n1 2026-03-09T18:22:14.699 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:14 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:14.441+0000 7f4b06215140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T18:22:14.887 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:22:15.252 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:15 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:15.069+0000 7f4b06215140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T18:22:15.252 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:15 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:15.206+0000 7f4b06215140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T18:22:15.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[50486]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:15.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:22:15.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:22:15.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:15.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:15 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:15 vm03 ceph-mon[54135]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:15.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:15 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:15 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:15 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:15 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:15 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:22:15.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:15 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:22:15.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:15 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:15.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:15 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:15.249+0000 7f4b06215140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T18:22:15.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:15 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:15.288+0000 7f4b06215140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T18:22:15.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:15 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:15.344+0000 7f4b06215140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T18:22:15.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:15 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:15.383+0000 7f4b06215140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T18:22:15.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[56210]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:15.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:15.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:22:15.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:22:15.608 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:15 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:15.886 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:15 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:15.571+0000 7f4b06215140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T18:22:15.887 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:15 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:15.628+0000 7f4b06215140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T18:22:16.212 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:15 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:15.884+0000 7f4b06215140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T18:22:16.309 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:16 vm02 ceph-mon[56210]: from='client.24101 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm02:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:16.309 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:16 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1823240018' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fed479aa-8268-4fe5-8e7c-7c393735e28c"}]: dispatch 2026-03-09T18:22:16.309 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:16 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1823240018' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fed479aa-8268-4fe5-8e7c-7c393735e28c"}]': finished 2026-03-09T18:22:16.309 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:16 vm02 ceph-mon[56210]: osdmap e5: 1 total, 0 up, 1 in 2026-03-09T18:22:16.309 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:16.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:16 vm03 ceph-mon[54135]: from='client.24101 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm02:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:16.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:16 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1823240018' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fed479aa-8268-4fe5-8e7c-7c393735e28c"}]: dispatch 2026-03-09T18:22:16.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:16 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1823240018' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fed479aa-8268-4fe5-8e7c-7c393735e28c"}]': finished 2026-03-09T18:22:16.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:16 vm03 ceph-mon[54135]: osdmap e5: 1 total, 0 up, 1 in 2026-03-09T18:22:16.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:16.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:16 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:16.209+0000 7f4b06215140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T18:22:16.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:16 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:16.258+0000 7f4b06215140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T18:22:16.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:16 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:16.305+0000 7f4b06215140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T18:22:16.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:16 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:16.390+0000 7f4b06215140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T18:22:16.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:16 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:16.429+0000 7f4b06215140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T18:22:16.583 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:16 vm02 ceph-mon[50486]: from='client.24101 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm02:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:16.583 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:16 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1823240018' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fed479aa-8268-4fe5-8e7c-7c393735e28c"}]: dispatch 2026-03-09T18:22:16.583 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:16 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1823240018' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fed479aa-8268-4fe5-8e7c-7c393735e28c"}]': finished 2026-03-09T18:22:16.583 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:16 vm02 ceph-mon[50486]: osdmap e5: 1 total, 0 up, 1 in 2026-03-09T18:22:16.583 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:16.800 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:16 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:16.517+0000 7f4b06215140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T18:22:16.800 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:16 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:16.645+0000 7f4b06215140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T18:22:17.253 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:16 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:16.797+0000 7f4b06215140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T18:22:17.253 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:22:16 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:22:16.840+0000 7f4b06215140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T18:22:17.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:17 vm02 ceph-mon[50486]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:17.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:17 vm02 ceph-mon[50486]: Standby manager daemon x started 2026-03-09T18:22:17.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:17 vm02 ceph-mon[50486]: from='mgr.? 192.168.123.103:0/1784927735' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2026-03-09T18:22:17.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:17 vm02 ceph-mon[50486]: from='mgr.? 192.168.123.103:0/1784927735' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-03-09T18:22:17.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:17 vm02 ceph-mon[50486]: from='mgr.? 192.168.123.103:0/1784927735' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2026-03-09T18:22:17.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:17 vm02 ceph-mon[50486]: from='mgr.? 192.168.123.103:0/1784927735' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-03-09T18:22:17.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:17 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3866386816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:22:17.606 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:17 vm02 ceph-mon[56210]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:17.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:17 vm02 ceph-mon[56210]: Standby manager daemon x started 2026-03-09T18:22:17.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:17 vm02 ceph-mon[56210]: from='mgr.? 192.168.123.103:0/1784927735' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2026-03-09T18:22:17.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:17 vm02 ceph-mon[56210]: from='mgr.? 192.168.123.103:0/1784927735' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-03-09T18:22:17.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:17 vm02 ceph-mon[56210]: from='mgr.? 192.168.123.103:0/1784927735' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2026-03-09T18:22:17.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:17 vm02 ceph-mon[56210]: from='mgr.? 192.168.123.103:0/1784927735' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-03-09T18:22:17.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:17 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3866386816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:22:17.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:17 vm03 ceph-mon[54135]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:17.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:17 vm03 ceph-mon[54135]: Standby manager daemon x started 2026-03-09T18:22:17.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:17 vm03 ceph-mon[54135]: from='mgr.? 192.168.123.103:0/1784927735' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2026-03-09T18:22:17.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:17 vm03 ceph-mon[54135]: from='mgr.? 192.168.123.103:0/1784927735' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-03-09T18:22:17.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:17 vm03 ceph-mon[54135]: from='mgr.? 192.168.123.103:0/1784927735' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2026-03-09T18:22:17.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:17 vm03 ceph-mon[54135]: from='mgr.? 192.168.123.103:0/1784927735' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-03-09T18:22:17.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:17 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3866386816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:22:18.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:18 vm02 ceph-mon[50486]: mgrmap e13: y(active, since 31s), standbys: x 2026-03-09T18:22:18.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:18 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-03-09T18:22:18.606 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:18 vm02 ceph-mon[56210]: mgrmap e13: y(active, since 31s), standbys: x 2026-03-09T18:22:18.606 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:18 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-03-09T18:22:18.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:18 vm03 ceph-mon[54135]: mgrmap e13: y(active, since 31s), standbys: x 2026-03-09T18:22:18.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:18 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-03-09T18:22:19.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:19 vm02 ceph-mon[50486]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:19.606 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:19 vm02 ceph-mon[56210]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:19.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:19 vm03 ceph-mon[54135]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:21.665 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:21 vm02 ceph-mon[50486]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:21.665 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:21 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-03-09T18:22:21.665 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:21 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:21.666 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:21 vm02 ceph-mon[56210]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:21.666 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:21 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-03-09T18:22:21.666 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:21 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:21.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:21 vm03 ceph-mon[54135]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:21.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:21 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-03-09T18:22:21.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:21 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:22.490 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:22 vm02 ceph-mon[50486]: Deploying daemon osd.0 on vm02 2026-03-09T18:22:22.490 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:22 vm02 ceph-mon[56210]: Deploying daemon osd.0 on vm02 2026-03-09T18:22:22.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:22 vm03 ceph-mon[54135]: Deploying daemon osd.0 on vm02 2026-03-09T18:22:23.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:23 vm03 ceph-mon[54135]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:23.756 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:23 vm02 ceph-mon[50486]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:23.756 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:23 vm02 ceph-mon[56210]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:24.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:24 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:24.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:24 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:24.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:24 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:24.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:24 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:24.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:24 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:24.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:24 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:24.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:24 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:24.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:24 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:24.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:24 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:24.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:24 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:24.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:24 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:24.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:24 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:24.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:24 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:24.763 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:24 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:24.763 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:24 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:24.763 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:24 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:24.763 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:24 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:24.763 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:24 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:25.547 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:25 vm02 ceph-mon[56210]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:25.547 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:25 vm02 ceph-mon[50486]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:25.713 INFO:teuthology.orchestra.run.vm02.stdout:Created osd(s) 0 on host 'vm02' 2026-03-09T18:22:25.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:25 vm03 ceph-mon[54135]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:25.885 DEBUG:teuthology.orchestra.run.vm02:osd.0> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.0.service 2026-03-09T18:22:25.887 INFO:tasks.cephadm:Deploying osd.1 on vm02 with /dev/nvme2n1... 2026-03-09T18:22:25.887 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- lvm zap /dev/nvme2n1 2026-03-09T18:22:26.124 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[50486]: from='osd.0 [v2:192.168.123.102:6802/201462935,v1:192.168.123.102:6803/201462935]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[50486]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[56210]: from='osd.0 [v2:192.168.123.102:6802/201462935,v1:192.168.123.102:6803/201462935]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T18:22:26.692 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:26 vm02 ceph-mon[56210]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T18:22:26.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:26 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:26.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:26 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:22:26.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:26 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:26.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:26 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:26.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:26 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:26.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:26 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:26.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:26 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:26.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:26 vm03 ceph-mon[54135]: from='osd.0 [v2:192.168.123.102:6802/201462935,v1:192.168.123.102:6803/201462935]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T18:22:26.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:26 vm03 ceph-mon[54135]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]: dispatch 2026-03-09T18:22:27.532 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:22:27.549 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch daemon add osd vm02:/dev/nvme2n1 2026-03-09T18:22:27.753 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:22:27.835 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[50486]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:27.835 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[50486]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]': finished 2026-03-09T18:22:27.835 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[50486]: from='osd.0 [v2:192.168.123.102:6802/201462935,v1:192.168.123.102:6803/201462935]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:27.835 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[50486]: osdmap e6: 1 total, 0 up, 1 in 2026-03-09T18:22:27.835 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:27.835 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[50486]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:27.835 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:27.835 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:27.835 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:27.835 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[56210]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:27.836 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[56210]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]': finished 2026-03-09T18:22:27.836 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[56210]: from='osd.0 [v2:192.168.123.102:6802/201462935,v1:192.168.123.102:6803/201462935]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:27.836 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[56210]: osdmap e6: 1 total, 0 up, 1 in 2026-03-09T18:22:27.836 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:27.836 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[56210]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:27.836 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:27.836 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:27.836 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:27 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:28.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:27 vm03 ceph-mon[54135]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:28.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:27 vm03 ceph-mon[54135]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["0"]}]': finished 2026-03-09T18:22:28.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:27 vm03 ceph-mon[54135]: from='osd.0 [v2:192.168.123.102:6802/201462935,v1:192.168.123.102:6803/201462935]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:28.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:27 vm03 ceph-mon[54135]: osdmap e6: 1 total, 0 up, 1 in 2026-03-09T18:22:28.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:27 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:28.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:27 vm03 ceph-mon[54135]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:28.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:27 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:28.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:27 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:28.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:27 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[50486]: Detected new or changed devices on vm02 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[50486]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm02", "root=default"]}]': finished 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[50486]: osdmap e7: 1 total, 0 up, 1 in 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[50486]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm02:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[56210]: Detected new or changed devices on vm02 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[56210]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm02", "root=default"]}]': finished 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[56210]: osdmap e7: 1 total, 0 up, 1 in 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[56210]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm02:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:28.978 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:28 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:28.978 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:22:28 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-0[60651]: 2026-03-09T18:22:28.849+0000 7f2e33f6d640 -1 osd.0 0 waiting for initial osdmap 2026-03-09T18:22:28.978 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:22:28 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-0[60651]: 2026-03-09T18:22:28.853+0000 7f2e2f596640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T18:22:29.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:28 vm03 ceph-mon[54135]: Detected new or changed devices on vm02 2026-03-09T18:22:29.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:28 vm03 ceph-mon[54135]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0195, "args": ["host=vm02", "root=default"]}]': finished 2026-03-09T18:22:29.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:28 vm03 ceph-mon[54135]: osdmap e7: 1 total, 0 up, 1 in 2026-03-09T18:22:29.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:28 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:29.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:28 vm03 ceph-mon[54135]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm02:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:29.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:28 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:22:29.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:28 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:22:29.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:28 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:29.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:28 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:30.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[50486]: purged_snaps scrub starts 2026-03-09T18:22:30.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[50486]: purged_snaps scrub ok 2026-03-09T18:22:30.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[50486]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:30.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[50486]: from='osd.0 ' entity='osd.0' 2026-03-09T18:22:30.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3562423610' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1736e6d8-0962-4235-9bc7-ee9697be5f2f"}]: dispatch 2026-03-09T18:22:30.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[50486]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1736e6d8-0962-4235-9bc7-ee9697be5f2f"}]: dispatch 2026-03-09T18:22:30.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[50486]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1736e6d8-0962-4235-9bc7-ee9697be5f2f"}]': finished 2026-03-09T18:22:30.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[50486]: osd.0 [v2:192.168.123.102:6802/201462935,v1:192.168.123.102:6803/201462935] boot 2026-03-09T18:22:30.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[50486]: osdmap e8: 2 total, 1 up, 2 in 2026-03-09T18:22:30.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:30.107 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:30.107 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1199596001' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:22:30.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[56210]: purged_snaps scrub starts 2026-03-09T18:22:30.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[56210]: purged_snaps scrub ok 2026-03-09T18:22:30.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[56210]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:30.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[56210]: from='osd.0 ' entity='osd.0' 2026-03-09T18:22:30.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3562423610' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1736e6d8-0962-4235-9bc7-ee9697be5f2f"}]: dispatch 2026-03-09T18:22:30.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[56210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1736e6d8-0962-4235-9bc7-ee9697be5f2f"}]: dispatch 2026-03-09T18:22:30.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[56210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1736e6d8-0962-4235-9bc7-ee9697be5f2f"}]': finished 2026-03-09T18:22:30.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[56210]: osd.0 [v2:192.168.123.102:6802/201462935,v1:192.168.123.102:6803/201462935] boot 2026-03-09T18:22:30.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[56210]: osdmap e8: 2 total, 1 up, 2 in 2026-03-09T18:22:30.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:30.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:30.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:29 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1199596001' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:22:30.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:29 vm03 ceph-mon[54135]: purged_snaps scrub starts 2026-03-09T18:22:30.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:29 vm03 ceph-mon[54135]: purged_snaps scrub ok 2026-03-09T18:22:30.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:29 vm03 ceph-mon[54135]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-03-09T18:22:30.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:29 vm03 ceph-mon[54135]: from='osd.0 ' entity='osd.0' 2026-03-09T18:22:30.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:29 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3562423610' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1736e6d8-0962-4235-9bc7-ee9697be5f2f"}]: dispatch 2026-03-09T18:22:30.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:29 vm03 ceph-mon[54135]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1736e6d8-0962-4235-9bc7-ee9697be5f2f"}]: dispatch 2026-03-09T18:22:30.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:29 vm03 ceph-mon[54135]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1736e6d8-0962-4235-9bc7-ee9697be5f2f"}]': finished 2026-03-09T18:22:30.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:29 vm03 ceph-mon[54135]: osd.0 [v2:192.168.123.102:6802/201462935,v1:192.168.123.102:6803/201462935] boot 2026-03-09T18:22:30.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:29 vm03 ceph-mon[54135]: osdmap e8: 2 total, 1 up, 2 in 2026-03-09T18:22:30.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:29 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:22:30.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:29 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:30.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:29 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1199596001' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:22:32.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:31 vm02 ceph-mon[50486]: pgmap v20: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:32.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:31 vm02 ceph-mon[50486]: osdmap e9: 2 total, 1 up, 2 in 2026-03-09T18:22:32.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:31 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:32.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:31 vm02 ceph-mon[56210]: pgmap v20: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:32.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:31 vm02 ceph-mon[56210]: osdmap e9: 2 total, 1 up, 2 in 2026-03-09T18:22:32.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:31 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:32.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:31 vm03 ceph-mon[54135]: pgmap v20: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:32.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:31 vm03 ceph-mon[54135]: osdmap e9: 2 total, 1 up, 2 in 2026-03-09T18:22:32.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:31 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:33.929 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:33 vm02 ceph-mon[50486]: pgmap v22: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:33.929 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:33 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-03-09T18:22:33.929 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:33 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:33.929 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:33 vm02 ceph-mon[56210]: pgmap v22: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:33.929 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:33 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-03-09T18:22:33.929 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:33 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:34.161 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:33 vm03 ceph-mon[54135]: pgmap v22: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:34.161 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:33 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-03-09T18:22:34.161 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:33 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:35.045 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:34 vm02 ceph-mon[50486]: Deploying daemon osd.1 on vm02 2026-03-09T18:22:35.045 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:34 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:35.046 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:34 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:35.046 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:34 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:35.046 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:34 vm02 ceph-mon[56210]: Deploying daemon osd.1 on vm02 2026-03-09T18:22:35.046 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:34 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:35.046 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:34 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:35.046 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:34 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:35.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:34 vm03 ceph-mon[54135]: Deploying daemon osd.1 on vm02 2026-03-09T18:22:35.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:34 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:35.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:34 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:35.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:34 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:36.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:35 vm02 ceph-mon[56210]: pgmap v23: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:36.107 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:35 vm02 ceph-mon[50486]: pgmap v23: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:36.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:35 vm03 ceph-mon[54135]: pgmap v23: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:36.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:36 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:36.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:36 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:36.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:36 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:36.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:36 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:36.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:36 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:36.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:36 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:36.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:36 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:36.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:36 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:36.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:36 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:36.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:36 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:36.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:36 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:36.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:36 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:37.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:36 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:37.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:36 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:37.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:36 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:37.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:36 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:37.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:36 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:37.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:36 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:37.818 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:37 vm02 ceph-mon[50486]: pgmap v24: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:38.101 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:37 vm02 ceph-mon[56210]: pgmap v24: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:38.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:37 vm03 ceph-mon[54135]: pgmap v24: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:38.280 INFO:teuthology.orchestra.run.vm02.stdout:Created osd(s) 1 on host 'vm02' 2026-03-09T18:22:38.436 DEBUG:teuthology.orchestra.run.vm02:osd.1> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.1.service 2026-03-09T18:22:38.438 INFO:tasks.cephadm:Deploying osd.2 on vm02 with /dev/nvme1n1... 2026-03-09T18:22:38.438 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- lvm zap /dev/nvme1n1 2026-03-09T18:22:38.686 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[56210]: from='osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:39.010 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:38 vm02 ceph-mon[50486]: from='osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-09T18:22:39.252 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:38 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:39.268 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:38 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:22:39.268 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:38 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:39.268 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:38 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:39.268 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:38 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:39.268 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:38 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:39.268 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:38 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:39.268 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:38 vm03 ceph-mon[54135]: from='osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]: dispatch 2026-03-09T18:22:39.846 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:22:39.863 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch daemon add osd vm02:/dev/nvme1n1 2026-03-09T18:22:39.887 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:39 vm02 ceph-mon[50486]: pgmap v25: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:39.887 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:39 vm02 ceph-mon[50486]: from='osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]': finished 2026-03-09T18:22:39.887 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:39 vm02 ceph-mon[50486]: osdmap e10: 2 total, 1 up, 2 in 2026-03-09T18:22:39.887 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:39 vm02 ceph-mon[50486]: from='osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:39.887 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:39 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:39.887 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:39 vm02 ceph-mon[56210]: pgmap v25: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:39.887 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:39 vm02 ceph-mon[56210]: from='osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]': finished 2026-03-09T18:22:39.887 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:39 vm02 ceph-mon[56210]: osdmap e10: 2 total, 1 up, 2 in 2026-03-09T18:22:39.887 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:39 vm02 ceph-mon[56210]: from='osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:39.887 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:39 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:40.050 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:22:40.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:39 vm03 ceph-mon[54135]: pgmap v25: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:40.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:39 vm03 ceph-mon[54135]: from='osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["1"]}]': finished 2026-03-09T18:22:40.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:39 vm03 ceph-mon[54135]: osdmap e10: 2 total, 1 up, 2 in 2026-03-09T18:22:40.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:39 vm03 ceph-mon[54135]: from='osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:40.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:39 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:40.736 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:22:40 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-1[64282]: 2026-03-09T18:22:40.410+0000 7fa728fd0640 -1 osd.1 0 waiting for initial osdmap 2026-03-09T18:22:40.736 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:22:40 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-1[64282]: 2026-03-09T18:22:40.419+0000 7fa724dfa640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T18:22:41.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:40 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:22:41.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:40 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:22:41.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:40 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:41.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:40 vm02 ceph-mon[50486]: from='osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm02", "root=default"]}]': finished 2026-03-09T18:22:41.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:40 vm02 ceph-mon[50486]: osdmap e11: 2 total, 1 up, 2 in 2026-03-09T18:22:41.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:40 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:41.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:40 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:22:41.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:40 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:22:41.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:40 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:41.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:40 vm02 ceph-mon[56210]: from='osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm02", "root=default"]}]': finished 2026-03-09T18:22:41.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:40 vm02 ceph-mon[56210]: osdmap e11: 2 total, 1 up, 2 in 2026-03-09T18:22:41.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:40 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:41.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:40 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:22:41.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:40 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:22:41.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:40 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:41.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:40 vm03 ceph-mon[54135]: from='osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0195, "args": ["host=vm02", "root=default"]}]': finished 2026-03-09T18:22:41.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:40 vm03 ceph-mon[54135]: osdmap e11: 2 total, 1 up, 2 in 2026-03-09T18:22:41.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:40 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[50486]: purged_snaps scrub starts 2026-03-09T18:22:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[50486]: purged_snaps scrub ok 2026-03-09T18:22:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[50486]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm02:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[50486]: pgmap v27: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3706687374' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e2314f8-be12-474e-a11e-3d5d46cc8c82"}]: dispatch 2026-03-09T18:22:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3706687374' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e2314f8-be12-474e-a11e-3d5d46cc8c82"}]': finished 2026-03-09T18:22:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[50486]: osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059] boot 2026-03-09T18:22:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[50486]: osdmap e12: 3 total, 2 up, 3 in 2026-03-09T18:22:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:42.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/2024750869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:22:42.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[56210]: purged_snaps scrub starts 2026-03-09T18:22:42.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[56210]: purged_snaps scrub ok 2026-03-09T18:22:42.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[56210]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm02:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:42.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[56210]: pgmap v27: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:42.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3706687374' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e2314f8-be12-474e-a11e-3d5d46cc8c82"}]: dispatch 2026-03-09T18:22:42.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3706687374' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e2314f8-be12-474e-a11e-3d5d46cc8c82"}]': finished 2026-03-09T18:22:42.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[56210]: osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059] boot 2026-03-09T18:22:42.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[56210]: osdmap e12: 3 total, 2 up, 3 in 2026-03-09T18:22:42.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:42.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:42.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:41 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/2024750869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:22:42.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:41 vm03 ceph-mon[54135]: purged_snaps scrub starts 2026-03-09T18:22:42.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:41 vm03 ceph-mon[54135]: purged_snaps scrub ok 2026-03-09T18:22:42.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:41 vm03 ceph-mon[54135]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm02:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:42.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:41 vm03 ceph-mon[54135]: pgmap v27: 0 pgs: ; 0 B data, 426 MiB used, 20 GiB / 20 GiB avail 2026-03-09T18:22:42.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:41 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3706687374' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e2314f8-be12-474e-a11e-3d5d46cc8c82"}]: dispatch 2026-03-09T18:22:42.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:41 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3706687374' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e2314f8-be12-474e-a11e-3d5d46cc8c82"}]': finished 2026-03-09T18:22:42.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:41 vm03 ceph-mon[54135]: osd.1 [v2:192.168.123.102:6810/1304575059,v1:192.168.123.102:6811/1304575059] boot 2026-03-09T18:22:42.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:41 vm03 ceph-mon[54135]: osdmap e12: 3 total, 2 up, 3 in 2026-03-09T18:22:42.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:41 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:22:42.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:41 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:42.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:41 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/2024750869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:22:43.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:43 vm02 ceph-mon[50486]: osdmap e13: 3 total, 2 up, 3 in 2026-03-09T18:22:43.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:43 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:43.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:43 vm02 ceph-mon[50486]: pgmap v31: 0 pgs: ; 0 B data, 453 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:43.606 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:43 vm02 ceph-mon[56210]: osdmap e13: 3 total, 2 up, 3 in 2026-03-09T18:22:43.606 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:43 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:43.606 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:43 vm02 ceph-mon[56210]: pgmap v31: 0 pgs: ; 0 B data, 453 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:43.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:43 vm03 ceph-mon[54135]: osdmap e13: 3 total, 2 up, 3 in 2026-03-09T18:22:43.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:43 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:43.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:43 vm03 ceph-mon[54135]: pgmap v31: 0 pgs: ; 0 B data, 453 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:45.669 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:45 vm02 ceph-mon[50486]: pgmap v32: 0 pgs: ; 0 B data, 453 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:45.669 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:45 vm02 ceph-mon[56210]: pgmap v32: 0 pgs: ; 0 B data, 453 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:45.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:45 vm03 ceph-mon[54135]: pgmap v32: 0 pgs: ; 0 B data, 453 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-03-09T18:22:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:46.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:46.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:46.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:46.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:46.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:46.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:46.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-03-09T18:22:46.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:46.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:46.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:46.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:46.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:46.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:46.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:46.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:46 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:46.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:46 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-03-09T18:22:46.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:46 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:46.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:46 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:46.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:46 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:46.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:46 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:46.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:46 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:46.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:46 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:46.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:46 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:46.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:46 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:47.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:47 vm02 ceph-mon[56210]: Deploying daemon osd.2 on vm02 2026-03-09T18:22:47.615 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:47 vm02 ceph-mon[56210]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:47.616 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:47 vm02 ceph-mon[50486]: Deploying daemon osd.2 on vm02 2026-03-09T18:22:47.616 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:47 vm02 ceph-mon[50486]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:47.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:47 vm03 ceph-mon[54135]: Deploying daemon osd.2 on vm02 2026-03-09T18:22:47.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:47 vm03 ceph-mon[54135]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:49.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:49.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:49.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:49.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:49.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: Detected new or changed devices on vm02 2026-03-09T18:22:49.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:49.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: Reconfiguring osd.2 (unknown last config time)... 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[50486]: Reconfiguring daemon osd.2 on vm02 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: Detected new or changed devices on vm02 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: Reconfiguring osd.2 (unknown last config time)... 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:49.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:49 vm02 ceph-mon[56210]: Reconfiguring daemon osd.2 on vm02 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: Detected new or changed devices on vm02 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: Reconfiguring osd.2 (unknown last config time)... 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:50.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:49 vm03 ceph-mon[54135]: Reconfiguring daemon osd.2 on vm02 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[50486]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[56210]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:50.774 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:50 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:51.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:50 vm03 ceph-mon[54135]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2026-03-09T18:22:51.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:50 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:51.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:50 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:51.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:50 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:51.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:50 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:51.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:50 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:51.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:50 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:51.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:50 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:51.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:50 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:51.777 INFO:teuthology.orchestra.run.vm02.stdout:Created osd(s) 2 on host 'vm02' 2026-03-09T18:22:51.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:51 vm02 ceph-mon[50486]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:51.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:51 vm02 ceph-mon[50486]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2026-03-09T18:22:51.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:51 vm02 ceph-mon[50486]: Cluster is now healthy 2026-03-09T18:22:51.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:51 vm02 ceph-mon[56210]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:51.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:51 vm02 ceph-mon[56210]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2026-03-09T18:22:51.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:51 vm02 ceph-mon[56210]: Cluster is now healthy 2026-03-09T18:22:51.936 DEBUG:teuthology.orchestra.run.vm02:osd.2> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.2.service 2026-03-09T18:22:51.978 INFO:tasks.cephadm:Deploying osd.3 on vm02 with /dev/nvme0n1... 2026-03-09T18:22:51.978 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- lvm zap /dev/nvme0n1 2026-03-09T18:22:52.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:51 vm03 ceph-mon[54135]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:52.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:51 vm03 ceph-mon[54135]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2026-03-09T18:22:52.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:51 vm03 ceph-mon[54135]: Cluster is now healthy 2026-03-09T18:22:52.211 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:22:52.766 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:52.766 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:22:52.766 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:52.766 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:52.766 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[56210]: from='osd.2 [v2:192.168.123.102:6818/1444582995,v1:192.168.123.102:6819/1444582995]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]: dispatch 2026-03-09T18:22:52.766 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:52.766 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:52.766 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[56210]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]: dispatch 2026-03-09T18:22:52.766 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:52.767 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:52.767 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:22:52.767 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:52.767 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:52.767 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[50486]: from='osd.2 [v2:192.168.123.102:6818/1444582995,v1:192.168.123.102:6819/1444582995]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]: dispatch 2026-03-09T18:22:52.767 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:52.767 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:52.767 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[50486]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]: dispatch 2026-03-09T18:22:52.767 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:52 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:53.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:52 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:22:53.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:52 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:22:53.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:52 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:53.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:52 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:53.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:52 vm03 ceph-mon[54135]: from='osd.2 [v2:192.168.123.102:6818/1444582995,v1:192.168.123.102:6819/1444582995]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]: dispatch 2026-03-09T18:22:53.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:52 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:53.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:52 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:22:53.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:52 vm03 ceph-mon[54135]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]: dispatch 2026-03-09T18:22:53.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:52 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:53.272 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:22:53.297 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch daemon add osd vm02:/dev/nvme0n1 2026-03-09T18:22:53.502 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:22:54.060 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:53 vm02 ceph-mon[50486]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:54.061 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:53 vm02 ceph-mon[50486]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]': finished 2026-03-09T18:22:54.061 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:53 vm02 ceph-mon[50486]: osdmap e14: 3 total, 2 up, 3 in 2026-03-09T18:22:54.061 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:53 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:54.061 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:53 vm02 ceph-mon[50486]: from='osd.2 [v2:192.168.123.102:6818/1444582995,v1:192.168.123.102:6819/1444582995]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:54.061 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:53 vm02 ceph-mon[50486]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:54.061 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:53 vm02 ceph-mon[56210]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:54.061 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:53 vm02 ceph-mon[56210]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]': finished 2026-03-09T18:22:54.061 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:53 vm02 ceph-mon[56210]: osdmap e14: 3 total, 2 up, 3 in 2026-03-09T18:22:54.061 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:53 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:54.061 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:53 vm02 ceph-mon[56210]: from='osd.2 [v2:192.168.123.102:6818/1444582995,v1:192.168.123.102:6819/1444582995]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:54.061 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:53 vm02 ceph-mon[56210]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:54.061 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:22:53 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-2[68015]: 2026-03-09T18:22:53.806+0000 7fae7d9d9640 -1 osd.2 0 waiting for initial osdmap 2026-03-09T18:22:54.061 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:22:53 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-2[68015]: 2026-03-09T18:22:53.811+0000 7fae79803640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T18:22:54.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:53 vm03 ceph-mon[54135]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:54.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:53 vm03 ceph-mon[54135]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["2"]}]': finished 2026-03-09T18:22:54.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:53 vm03 ceph-mon[54135]: osdmap e14: 3 total, 2 up, 3 in 2026-03-09T18:22:54.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:53 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:54.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:53 vm03 ceph-mon[54135]: from='osd.2 [v2:192.168.123.102:6818/1444582995,v1:192.168.123.102:6819/1444582995]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:54.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:53 vm03 ceph-mon[54135]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[50486]: purged_snaps scrub starts 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[50486]: purged_snaps scrub ok 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[50486]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm02", "root=default"]}]': finished 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[50486]: osdmap e15: 3 total, 2 up, 3 in 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[50486]: from='client.24170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm02:/dev/nvme0n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[56210]: purged_snaps scrub starts 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[56210]: purged_snaps scrub ok 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[56210]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm02", "root=default"]}]': finished 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[56210]: osdmap e15: 3 total, 2 up, 3 in 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[56210]: from='client.24170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm02:/dev/nvme0n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:54.903 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:54 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:55.077 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:54 vm03 ceph-mon[54135]: purged_snaps scrub starts 2026-03-09T18:22:55.077 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:54 vm03 ceph-mon[54135]: purged_snaps scrub ok 2026-03-09T18:22:55.077 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:54 vm03 ceph-mon[54135]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0195, "args": ["host=vm02", "root=default"]}]': finished 2026-03-09T18:22:55.077 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:54 vm03 ceph-mon[54135]: osdmap e15: 3 total, 2 up, 3 in 2026-03-09T18:22:55.077 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:54 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:55.077 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:54 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:55.077 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:54 vm03 ceph-mon[54135]: from='client.24170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm02:/dev/nvme0n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:22:55.077 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:54 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:22:55.077 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:54 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:22:55.077 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:54 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:22:55.077 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:54 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:55.077 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:54 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:55.077 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:54 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[50486]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[50486]: osd.2 [v2:192.168.123.102:6818/1444582995,v1:192.168.123.102:6819/1444582995] boot 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[50486]: osdmap e16: 3 total, 3 up, 3 in 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3989955416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5388e10f-3054-4eea-a54e-1a6b4abe8a68"}]: dispatch 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3989955416' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5388e10f-3054-4eea-a54e-1a6b4abe8a68"}]': finished 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[50486]: osdmap e17: 4 total, 3 up, 4 in 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3744758009' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[56210]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[56210]: osd.2 [v2:192.168.123.102:6818/1444582995,v1:192.168.123.102:6819/1444582995] boot 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[56210]: osdmap e16: 3 total, 3 up, 3 in 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3989955416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5388e10f-3054-4eea-a54e-1a6b4abe8a68"}]: dispatch 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3989955416' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5388e10f-3054-4eea-a54e-1a6b4abe8a68"}]': finished 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[56210]: osdmap e17: 4 total, 3 up, 4 in 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:22:56.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:55 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3744758009' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:22:56.252 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:55 vm03 ceph-mon[54135]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 40 GiB / 40 GiB avail 2026-03-09T18:22:56.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:55 vm03 ceph-mon[54135]: osd.2 [v2:192.168.123.102:6818/1444582995,v1:192.168.123.102:6819/1444582995] boot 2026-03-09T18:22:56.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:55 vm03 ceph-mon[54135]: osdmap e16: 3 total, 3 up, 3 in 2026-03-09T18:22:56.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:55 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:22:56.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:55 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3989955416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5388e10f-3054-4eea-a54e-1a6b4abe8a68"}]: dispatch 2026-03-09T18:22:56.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:55 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3989955416' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5388e10f-3054-4eea-a54e-1a6b4abe8a68"}]': finished 2026-03-09T18:22:56.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:55 vm03 ceph-mon[54135]: osdmap e17: 4 total, 3 up, 4 in 2026-03-09T18:22:56.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:55 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:22:56.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:55 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3744758009' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:22:57.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:56 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-03-09T18:22:57.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:56 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-03-09T18:22:57.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:56 vm02 ceph-mon[50486]: osdmap e18: 4 total, 3 up, 4 in 2026-03-09T18:22:57.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:56 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:22:57.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:56 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-03-09T18:22:57.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:56 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-03-09T18:22:57.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:56 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-03-09T18:22:57.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:56 vm02 ceph-mon[56210]: osdmap e18: 4 total, 3 up, 4 in 2026-03-09T18:22:57.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:56 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:22:57.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:56 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-03-09T18:22:57.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:56 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-03-09T18:22:57.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:56 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-03-09T18:22:57.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:56 vm03 ceph-mon[54135]: osdmap e18: 4 total, 3 up, 4 in 2026-03-09T18:22:57.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:56 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:22:57.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:56 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-03-09T18:22:58.064 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:57 vm02 ceph-mon[50486]: pgmap v45: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:22:58.064 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:57 vm02 ceph-mon[50486]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-03-09T18:22:58.064 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-03-09T18:22:58.064 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:57 vm02 ceph-mon[50486]: osdmap e19: 4 total, 3 up, 4 in 2026-03-09T18:22:58.064 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:22:58.064 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:57 vm02 ceph-mon[56210]: pgmap v45: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:22:58.064 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:57 vm02 ceph-mon[56210]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-03-09T18:22:58.064 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:57 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-03-09T18:22:58.064 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:57 vm02 ceph-mon[56210]: osdmap e19: 4 total, 3 up, 4 in 2026-03-09T18:22:58.064 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:57 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:22:58.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:57 vm03 ceph-mon[54135]: pgmap v45: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:22:58.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:57 vm03 ceph-mon[54135]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-03-09T18:22:58.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:57 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-03-09T18:22:58.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:57 vm03 ceph-mon[54135]: osdmap e19: 4 total, 3 up, 4 in 2026-03-09T18:22:58.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:57 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70436]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme3n1 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70436]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70436]: pam_unix(sudo:session): session closed for user root 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70440]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme linux smart-log-add --json /dev/nvme3n1 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70440]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70440]: pam_unix(sudo:session): session closed for user root 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70444]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70444]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70444]: pam_unix(sudo:session): session closed for user root 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70448]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme linux smart-log-add --json /dev/nvme2n1 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70448]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T18:22:58.317 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70448]: pam_unix(sudo:session): session closed for user root 2026-03-09T18:22:58.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70478]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vda 2026-03-09T18:22:58.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70478]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T18:22:58.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T18:22:58.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70478]: pam_unix(sudo:session): session closed for user root 2026-03-09T18:22:58.606 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70482]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vda 2026-03-09T18:22:58.606 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70482]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T18:22:58.606 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T18:22:58.606 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70482]: pam_unix(sudo:session): session closed for user root 2026-03-09T18:22:58.607 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70470]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-03-09T18:22:58.607 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70470]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T18:22:58.607 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T18:22:58.607 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70470]: pam_unix(sudo:session): session closed for user root 2026-03-09T18:22:58.607 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70474]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme linux smart-log-add --json /dev/nvme1n1 2026-03-09T18:22:58.607 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70474]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T18:22:58.607 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T18:22:58.607 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:22:58 vm02 sudo[70474]: pam_unix(sudo:session): session closed for user root 2026-03-09T18:22:58.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:58 vm03 sudo[57873]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/vda 2026-03-09T18:22:58.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:58 vm03 sudo[57873]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-03-09T18:22:58.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:58 vm03 sudo[57873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-03-09T18:22:58.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:58 vm03 sudo[57873]: pam_unix(sudo:session): session closed for user root 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: pgmap v47: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: osdmap e20: 4 total, 3 up, 4 in 2026-03-09T18:22:59.240 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: pgmap v47: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: osdmap e20: 4 total, 3 up, 4 in 2026-03-09T18:22:59.241 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:22:59 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: pgmap v47: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: osdmap e20: 4 total, 3 up, 4 in 2026-03-09T18:22:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:22:59 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:00.581 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:00 vm02 ceph-mon[50486]: mgrmap e14: y(active, since 73s), standbys: x 2026-03-09T18:23:00.581 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:00 vm02 ceph-mon[50486]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-03-09T18:23:00.581 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:00 vm02 ceph-mon[50486]: Cluster is now healthy 2026-03-09T18:23:00.581 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:00 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-03-09T18:23:00.581 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:00 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:00.581 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:00 vm02 ceph-mon[50486]: Deploying daemon osd.3 on vm02 2026-03-09T18:23:00.581 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:00 vm02 ceph-mon[56210]: mgrmap e14: y(active, since 73s), standbys: x 2026-03-09T18:23:00.581 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:00 vm02 ceph-mon[56210]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-03-09T18:23:00.581 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:00 vm02 ceph-mon[56210]: Cluster is now healthy 2026-03-09T18:23:00.581 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-03-09T18:23:00.581 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:00 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:00.581 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:00 vm02 ceph-mon[56210]: Deploying daemon osd.3 on vm02 2026-03-09T18:23:00.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:00 vm03 ceph-mon[54135]: mgrmap e14: y(active, since 73s), standbys: x 2026-03-09T18:23:00.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:00 vm03 ceph-mon[54135]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-03-09T18:23:00.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:00 vm03 ceph-mon[54135]: Cluster is now healthy 2026-03-09T18:23:00.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:00 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-03-09T18:23:00.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:00 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:00.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:00 vm03 ceph-mon[54135]: Deploying daemon osd.3 on vm02 2026-03-09T18:23:01.747 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:01 vm02 ceph-mon[50486]: pgmap v49: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:23:01.747 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:01 vm02 ceph-mon[56210]: pgmap v49: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:23:01.752 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:01 vm03 ceph-mon[54135]: pgmap v49: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:23:02.744 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:02 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:02.744 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:02 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:02.744 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:02 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:02.744 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:02 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:02.744 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:02 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:02.744 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:02 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:02.744 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:02 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:02.744 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:02 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:02.744 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:02 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:02.744 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:02 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:02.744 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:02 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:02.744 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:02 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:03.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:02 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:03.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:02 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:03.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:02 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:03.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:02 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:03.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:02 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:03.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:02 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:03.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:03 vm02 ceph-mon[50486]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:23:03.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:03 vm02 ceph-mon[56210]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:23:04.002 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:03 vm03 ceph-mon[54135]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:23:04.098 INFO:teuthology.orchestra.run.vm02.stdout:Created osd(s) 3 on host 'vm02' 2026-03-09T18:23:04.267 DEBUG:teuthology.orchestra.run.vm02:osd.3> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.3.service 2026-03-09T18:23:04.269 INFO:tasks.cephadm:Deploying osd.4 on vm03 with /dev/nvme3n1... 2026-03-09T18:23:04.269 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- lvm zap /dev/nvme3n1 2026-03-09T18:23:04.439 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:23:04.553 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:04 vm03 ceph-mon[54135]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["3"]}]: dispatch 2026-03-09T18:23:04.554 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:04.554 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:04.554 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:04.554 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:04.554 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:04.554 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:04.554 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[50486]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["3"]}]: dispatch 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[56210]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["3"]}]: dispatch 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:04.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:04 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:05.540 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T18:23:05.563 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch daemon add osd vm03:/dev/nvme3n1 2026-03-09T18:23:05.589 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:05 vm03 ceph-mon[54135]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:23:05.589 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:05 vm03 ceph-mon[54135]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["3"]}]': finished 2026-03-09T18:23:05.589 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:05 vm03 ceph-mon[54135]: osdmap e21: 4 total, 3 up, 4 in 2026-03-09T18:23:05.589 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:05 vm03 ceph-mon[54135]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:23:05.589 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:05 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:05.764 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:23:05.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:05 vm02 ceph-mon[50486]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:23:05.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:05 vm02 ceph-mon[50486]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["3"]}]': finished 2026-03-09T18:23:05.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:05 vm02 ceph-mon[50486]: osdmap e21: 4 total, 3 up, 4 in 2026-03-09T18:23:05.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:05 vm02 ceph-mon[50486]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:23:05.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:05 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:05.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:05 vm02 ceph-mon[56210]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:23:05.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:05 vm02 ceph-mon[56210]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["3"]}]': finished 2026-03-09T18:23:05.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:05 vm02 ceph-mon[56210]: osdmap e21: 4 total, 3 up, 4 in 2026-03-09T18:23:05.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:05 vm02 ceph-mon[56210]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0195, "args": ["host=vm02", "root=default"]}]: dispatch 2026-03-09T18:23:05.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:05 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:06.844 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:06 vm03 ceph-mon[54135]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0195, "args": ["host=vm02", "root=default"]}]': finished 2026-03-09T18:23:06.844 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:06 vm03 ceph-mon[54135]: osdmap e22: 4 total, 3 up, 4 in 2026-03-09T18:23:06.844 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:06 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:06.844 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:06 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:06.844 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:06 vm03 ceph-mon[54135]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm03:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:23:06.844 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:06 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:23:06.845 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:06 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:23:06.845 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:06 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:06.857 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:23:06 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-3[71313]: 2026-03-09T18:23:06.541+0000 7f3605a29640 -1 osd.3 0 waiting for initial osdmap 2026-03-09T18:23:06.858 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:23:06 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-3[71313]: 2026-03-09T18:23:06.560+0000 7f3601052640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[50486]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0195, "args": ["host=vm02", "root=default"]}]': finished 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[50486]: osdmap e22: 4 total, 3 up, 4 in 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[50486]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm03:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[56210]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0195, "args": ["host=vm02", "root=default"]}]': finished 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[56210]: osdmap e22: 4 total, 3 up, 4 in 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[56210]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm03:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:23:06.858 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:06 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:07.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:07 vm03 ceph-mon[54135]: purged_snaps scrub starts 2026-03-09T18:23:07.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:07 vm03 ceph-mon[54135]: purged_snaps scrub ok 2026-03-09T18:23:07.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:07 vm03 ceph-mon[54135]: pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:23:07.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:07 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:07.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:07 vm03 ceph-mon[54135]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' 2026-03-09T18:23:07.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:07 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/3075646357' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4b55510-663a-4d2f-8c08-7f66cc8c0a9b"}]: dispatch 2026-03-09T18:23:07.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:07 vm03 ceph-mon[54135]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4b55510-663a-4d2f-8c08-7f66cc8c0a9b"}]: dispatch 2026-03-09T18:23:07.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:07 vm03 ceph-mon[54135]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4b55510-663a-4d2f-8c08-7f66cc8c0a9b"}]': finished 2026-03-09T18:23:07.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:07 vm03 ceph-mon[54135]: osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147] boot 2026-03-09T18:23:07.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:07 vm03 ceph-mon[54135]: osdmap e23: 5 total, 4 up, 5 in 2026-03-09T18:23:07.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:07 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:07.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:07 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:07.753 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:07 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/3817993601' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[50486]: purged_snaps scrub starts 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[50486]: purged_snaps scrub ok 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[50486]: pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[50486]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/3075646357' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4b55510-663a-4d2f-8c08-7f66cc8c0a9b"}]: dispatch 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[50486]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4b55510-663a-4d2f-8c08-7f66cc8c0a9b"}]: dispatch 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[50486]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4b55510-663a-4d2f-8c08-7f66cc8c0a9b"}]': finished 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[50486]: osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147] boot 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[50486]: osdmap e23: 5 total, 4 up, 5 in 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/3817993601' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[56210]: purged_snaps scrub starts 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[56210]: purged_snaps scrub ok 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[56210]: pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 60 GiB / 60 GiB avail 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[56210]: from='osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147]' entity='osd.3' 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/3075646357' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4b55510-663a-4d2f-8c08-7f66cc8c0a9b"}]: dispatch 2026-03-09T18:23:07.856 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[56210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4b55510-663a-4d2f-8c08-7f66cc8c0a9b"}]: dispatch 2026-03-09T18:23:07.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[56210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4b55510-663a-4d2f-8c08-7f66cc8c0a9b"}]': finished 2026-03-09T18:23:07.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[56210]: osd.3 [v2:192.168.123.102:6826/3447875147,v1:192.168.123.102:6827/3447875147] boot 2026-03-09T18:23:07.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[56210]: osdmap e23: 5 total, 4 up, 5 in 2026-03-09T18:23:07.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:23:07.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:07.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:07 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/3817993601' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:23:09.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:09.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: osdmap e24: 5 total, 4 up, 5 in 2026-03-09T18:23:09.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: Detected new or changed devices on vm02 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: osdmap e24: 5 total, 4 up, 5 in 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: Detected new or changed devices on vm02 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.858 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:09.858 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.858 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:09.858 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:09.858 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:09 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.935 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:09.935 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: osdmap e24: 5 total, 4 up, 5 in 2026-03-09T18:23:09.935 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:09.935 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.935 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.935 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:09.935 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: Detected new or changed devices on vm02 2026-03-09T18:23:09.935 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:09.935 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:09.935 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:09.935 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.935 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:09.936 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:09.936 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.936 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.936 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.936 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:09.936 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:09.936 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:09.936 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:09.936 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:09 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:10.948 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:10 vm03 ceph-mon[54135]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:11.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:10 vm02 ceph-mon[50486]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:11.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:10 vm02 ceph-mon[56210]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:11.870 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:11 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-03-09T18:23:11.870 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:11 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:12.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:11 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-03-09T18:23:12.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:11 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:12.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-03-09T18:23:12.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:13.004 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:12 vm03 ceph-mon[54135]: Deploying daemon osd.4 on vm03 2026-03-09T18:23:13.004 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:12 vm03 ceph-mon[54135]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:13.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:12 vm02 ceph-mon[50486]: Deploying daemon osd.4 on vm03 2026-03-09T18:23:13.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:12 vm02 ceph-mon[50486]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:13.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:12 vm02 ceph-mon[56210]: Deploying daemon osd.4 on vm03 2026-03-09T18:23:13.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:12 vm02 ceph-mon[56210]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:14.996 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:14 vm03 ceph-mon[54135]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:14.996 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:14.996 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:14.996 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:14.996 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:14.996 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:14.996 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:14.996 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:14.996 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:14.996 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:14.996 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:14.996 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:14.996 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:14.996 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:14 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:15.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[50486]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:15.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:15.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:15.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:15.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:15.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:15.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:15.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:15.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:15.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:15.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:15.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:15.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:15.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:15.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[56210]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:15.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:15.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:15.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:15.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:15.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:15.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:15.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:15.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:15.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:15.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:15.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:15.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:15.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:14 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.502 INFO:teuthology.orchestra.run.vm03.stdout:Created osd(s) 4 on host 'vm03' 2026-03-09T18:23:16.636 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: Detected new or changed devices on vm03 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='osd.4 [v2:192.168.123.103:6800/4190956836,v1:192.168.123.103:6801/4190956836]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]: dispatch 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]: dispatch 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.637 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:16 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.674 DEBUG:teuthology.orchestra.run.vm03:osd.4> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.4.service 2026-03-09T18:23:16.716 INFO:tasks.cephadm:Deploying osd.5 on vm03 with /dev/nvme2n1... 2026-03-09T18:23:16.717 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- lvm zap /dev/nvme2n1 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: Detected new or changed devices on vm03 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='osd.4 [v2:192.168.123.103:6800/4190956836,v1:192.168.123.103:6801/4190956836]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]: dispatch 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]: dispatch 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:16.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: Detected new or changed devices on vm03 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='osd.4 [v2:192.168.123.103:6800/4190956836,v1:192.168.123.103:6801/4190956836]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]: dispatch 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]: dispatch 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:16 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:16.958 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:23:17.838 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:17 vm03 ceph-mon[54135]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]': finished 2026-03-09T18:23:18.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:17 vm02 ceph-mon[50486]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]': finished 2026-03-09T18:23:18.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:17 vm02 ceph-mon[50486]: osdmap e25: 5 total, 4 up, 5 in 2026-03-09T18:23:18.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:17 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:18.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:17 vm02 ceph-mon[50486]: from='osd.4 [v2:192.168.123.103:6800/4190956836,v1:192.168.123.103:6801/4190956836]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:18.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:17 vm02 ceph-mon[50486]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:18.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:17 vm02 ceph-mon[56210]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["4"]}]': finished 2026-03-09T18:23:18.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:17 vm02 ceph-mon[56210]: osdmap e25: 5 total, 4 up, 5 in 2026-03-09T18:23:18.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:17 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:18.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:17 vm02 ceph-mon[56210]: from='osd.4 [v2:192.168.123.103:6800/4190956836,v1:192.168.123.103:6801/4190956836]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:18.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:17 vm02 ceph-mon[56210]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:18.119 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:17 vm03 ceph-mon[54135]: osdmap e25: 5 total, 4 up, 5 in 2026-03-09T18:23:18.120 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:17 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:18.120 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:17 vm03 ceph-mon[54135]: from='osd.4 [v2:192.168.123.103:6800/4190956836,v1:192.168.123.103:6801/4190956836]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:18.120 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:17 vm03 ceph-mon[54135]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:18.139 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T18:23:18.163 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch daemon add osd vm03:/dev/nvme2n1 2026-03-09T18:23:18.376 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:23:19.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[50486]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:19.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[50486]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm03", "root=default"]}]': finished 2026-03-09T18:23:19.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[50486]: osdmap e26: 5 total, 4 up, 5 in 2026-03-09T18:23:19.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:19.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[50486]: osdmap e27: 5 total, 4 up, 5 in 2026-03-09T18:23:19.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:19.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:23:19.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:23:19.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:19.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:19.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[56210]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:19.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[56210]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm03", "root=default"]}]': finished 2026-03-09T18:23:19.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[56210]: osdmap e26: 5 total, 4 up, 5 in 2026-03-09T18:23:19.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:19.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[56210]: osdmap e27: 5 total, 4 up, 5 in 2026-03-09T18:23:19.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:19.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:23:19.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:23:19.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:19.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:18 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:19.143 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:18 vm03 ceph-mon[54135]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:19.143 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:18 vm03 ceph-mon[54135]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0195, "args": ["host=vm03", "root=default"]}]': finished 2026-03-09T18:23:19.143 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:18 vm03 ceph-mon[54135]: osdmap e26: 5 total, 4 up, 5 in 2026-03-09T18:23:19.143 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:18 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:19.143 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:18 vm03 ceph-mon[54135]: osdmap e27: 5 total, 4 up, 5 in 2026-03-09T18:23:19.143 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:18 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:19.143 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:18 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:23:19.143 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:18 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:23:19.143 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:18 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:19.143 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:18 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:19.143 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:23:18 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-4[60326]: 2026-03-09T18:23:18.906+0000 7fb226d35640 -1 osd.4 0 waiting for initial osdmap 2026-03-09T18:23:19.143 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:23:18 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-4[60326]: 2026-03-09T18:23:18.915+0000 7fb221b4b640 -1 osd.4 27 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T18:23:20.197 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:19 vm03 ceph-mon[54135]: purged_snaps scrub starts 2026-03-09T18:23:20.197 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:19 vm03 ceph-mon[54135]: purged_snaps scrub ok 2026-03-09T18:23:20.197 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:19 vm03 ceph-mon[54135]: from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm03:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:23:20.197 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:19 vm03 ceph-mon[54135]: from='osd.4 ' entity='osd.4' 2026-03-09T18:23:20.197 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:19 vm03 ceph-mon[54135]: osd.4 [v2:192.168.123.103:6800/4190956836,v1:192.168.123.103:6801/4190956836] boot 2026-03-09T18:23:20.197 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:19 vm03 ceph-mon[54135]: osdmap e28: 5 total, 5 up, 5 in 2026-03-09T18:23:20.197 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:19 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:20.197 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:19 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/1918859955' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8af9ca3d-6e5b-4912-a874-64153fae561a"}]: dispatch 2026-03-09T18:23:20.198 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:19 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/1918859955' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8af9ca3d-6e5b-4912-a874-64153fae561a"}]': finished 2026-03-09T18:23:20.198 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:19 vm03 ceph-mon[54135]: osdmap e29: 6 total, 5 up, 6 in 2026-03-09T18:23:20.198 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:19 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:20.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[50486]: purged_snaps scrub starts 2026-03-09T18:23:20.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[50486]: purged_snaps scrub ok 2026-03-09T18:23:20.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[50486]: from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm03:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:23:20.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[50486]: from='osd.4 ' entity='osd.4' 2026-03-09T18:23:20.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[50486]: osd.4 [v2:192.168.123.103:6800/4190956836,v1:192.168.123.103:6801/4190956836] boot 2026-03-09T18:23:20.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[50486]: osdmap e28: 5 total, 5 up, 5 in 2026-03-09T18:23:20.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:20.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/1918859955' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8af9ca3d-6e5b-4912-a874-64153fae561a"}]: dispatch 2026-03-09T18:23:20.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/1918859955' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8af9ca3d-6e5b-4912-a874-64153fae561a"}]': finished 2026-03-09T18:23:20.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[50486]: osdmap e29: 6 total, 5 up, 6 in 2026-03-09T18:23:20.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:20.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[56210]: purged_snaps scrub starts 2026-03-09T18:23:20.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[56210]: purged_snaps scrub ok 2026-03-09T18:23:20.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[56210]: from='client.24211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm03:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:23:20.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[56210]: from='osd.4 ' entity='osd.4' 2026-03-09T18:23:20.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[56210]: osd.4 [v2:192.168.123.103:6800/4190956836,v1:192.168.123.103:6801/4190956836] boot 2026-03-09T18:23:20.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[56210]: osdmap e28: 5 total, 5 up, 5 in 2026-03-09T18:23:20.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:23:20.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/1918859955' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8af9ca3d-6e5b-4912-a874-64153fae561a"}]: dispatch 2026-03-09T18:23:20.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/1918859955' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8af9ca3d-6e5b-4912-a874-64153fae561a"}]': finished 2026-03-09T18:23:20.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[56210]: osdmap e29: 6 total, 5 up, 6 in 2026-03-09T18:23:20.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:19 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:21.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:20 vm03 ceph-mon[54135]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:21.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:20 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/425236887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:23:21.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:20 vm03 ceph-mon[54135]: osdmap e30: 6 total, 5 up, 6 in 2026-03-09T18:23:21.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:20 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:21.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:20 vm02 ceph-mon[50486]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:21.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:20 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/425236887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:23:21.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:20 vm02 ceph-mon[50486]: osdmap e30: 6 total, 5 up, 6 in 2026-03-09T18:23:21.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:20 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:21.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:20 vm02 ceph-mon[56210]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 80 GiB / 80 GiB avail 2026-03-09T18:23:21.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:20 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/425236887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:23:21.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:20 vm02 ceph-mon[56210]: osdmap e30: 6 total, 5 up, 6 in 2026-03-09T18:23:21.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:20 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:23.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:22 vm03 ceph-mon[54135]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 534 MiB used, 99 GiB / 100 GiB avail 2026-03-09T18:23:23.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:22 vm02 ceph-mon[50486]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 534 MiB used, 99 GiB / 100 GiB avail 2026-03-09T18:23:23.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:22 vm02 ceph-mon[56210]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 534 MiB used, 99 GiB / 100 GiB avail 2026-03-09T18:23:25.109 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:24 vm03 ceph-mon[54135]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 534 MiB used, 99 GiB / 100 GiB avail; 120 KiB/s, 0 objects/s recovering 2026-03-09T18:23:25.109 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:24 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-03-09T18:23:25.109 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:24 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:25.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:24 vm02 ceph-mon[50486]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 534 MiB used, 99 GiB / 100 GiB avail; 120 KiB/s, 0 objects/s recovering 2026-03-09T18:23:25.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:24 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-03-09T18:23:25.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:24 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:25.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:24 vm02 ceph-mon[56210]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 534 MiB used, 99 GiB / 100 GiB avail; 120 KiB/s, 0 objects/s recovering 2026-03-09T18:23:25.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:24 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-03-09T18:23:25.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:24 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:26.169 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:25 vm02 ceph-mon[50486]: Deploying daemon osd.5 on vm03 2026-03-09T18:23:26.170 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:25 vm02 ceph-mon[56210]: Deploying daemon osd.5 on vm03 2026-03-09T18:23:26.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:25 vm03 ceph-mon[54135]: Deploying daemon osd.5 on vm03 2026-03-09T18:23:27.119 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:26 vm03 ceph-mon[54135]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 100 GiB / 100 GiB avail; 96 KiB/s, 0 objects/s recovering 2026-03-09T18:23:27.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:26 vm02 ceph-mon[50486]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 100 GiB / 100 GiB avail; 96 KiB/s, 0 objects/s recovering 2026-03-09T18:23:27.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:26 vm02 ceph-mon[56210]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 100 GiB / 100 GiB avail; 96 KiB/s, 0 objects/s recovering 2026-03-09T18:23:28.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:27 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:28.254 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:27 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:28.254 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:27 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:28.254 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:27 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:28.254 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:27 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:28.254 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:27 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:28.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:27 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:28.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:27 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:28.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:27 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:28.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:27 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:28.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:27 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:28.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:27 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:28.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:27 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:28.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:27 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:28.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:27 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:28.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:27 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:28.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:27 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:28.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:27 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:29.030 INFO:teuthology.orchestra.run.vm03.stdout:Created osd(s) 5 on host 'vm03' 2026-03-09T18:23:29.088 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:28 vm03 ceph-mon[54135]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 74 KiB/s, 0 objects/s recovering 2026-03-09T18:23:29.088 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:28 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:29.088 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:28 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:29.088 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:28 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:29.187 DEBUG:teuthology.orchestra.run.vm03:osd.5> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.5.service 2026-03-09T18:23:29.189 INFO:tasks.cephadm:Deploying osd.6 on vm03 with /dev/nvme1n1... 2026-03-09T18:23:29.189 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- lvm zap /dev/nvme1n1 2026-03-09T18:23:29.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:28 vm02 ceph-mon[50486]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 74 KiB/s, 0 objects/s recovering 2026-03-09T18:23:29.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:28 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:29.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:28 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:29.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:28 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:29.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:28 vm02 ceph-mon[56210]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 74 KiB/s, 0 objects/s recovering 2026-03-09T18:23:29.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:28 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:29.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:28 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:29.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:28 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:29.418 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:23:29.961 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:29 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:29.961 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:29 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:29.961 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:29 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:29.961 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:29 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:29.961 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:29 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:29.961 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:29 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:29.961 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:29 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:29.961 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:29 vm03 ceph-mon[54135]: from='osd.5 [v2:192.168.123.103:6808/3715823931,v1:192.168.123.103:6809/3715823931]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]: dispatch 2026-03-09T18:23:29.961 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:29 vm03 ceph-mon[54135]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]: dispatch 2026-03-09T18:23:30.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:30.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:30.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:30.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:30.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:30.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:30.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:30.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[50486]: from='osd.5 [v2:192.168.123.103:6808/3715823931,v1:192.168.123.103:6809/3715823931]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]: dispatch 2026-03-09T18:23:30.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[50486]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]: dispatch 2026-03-09T18:23:30.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:30.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:30.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:30.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:30.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:30.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:30.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:30.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[56210]: from='osd.5 [v2:192.168.123.103:6808/3715823931,v1:192.168.123.103:6809/3715823931]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]: dispatch 2026-03-09T18:23:30.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:29 vm02 ceph-mon[56210]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]: dispatch 2026-03-09T18:23:30.529 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T18:23:30.547 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch daemon add osd vm03:/dev/nvme1n1 2026-03-09T18:23:30.750 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:23:31.231 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:31 vm03 ceph-mon[54135]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 60 KiB/s, 0 objects/s recovering 2026-03-09T18:23:31.231 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:31 vm03 ceph-mon[54135]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]': finished 2026-03-09T18:23:31.231 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:31 vm03 ceph-mon[54135]: from='osd.5 [v2:192.168.123.103:6808/3715823931,v1:192.168.123.103:6809/3715823931]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:31.231 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:31 vm03 ceph-mon[54135]: osdmap e31: 6 total, 5 up, 6 in 2026-03-09T18:23:31.231 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:31 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:31.231 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:31 vm03 ceph-mon[54135]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:31.231 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:31 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:23:31.231 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:31 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:23:31.231 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:31 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:31.231 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:23:31 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5[63950]: 2026-03-09T18:23:31.044+0000 7fa9fc5af640 -1 osd.5 0 waiting for initial osdmap 2026-03-09T18:23:31.231 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:23:31 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5[63950]: 2026-03-09T18:23:31.053+0000 7fa9f7bc6640 -1 osd.5 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T18:23:31.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[50486]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 60 KiB/s, 0 objects/s recovering 2026-03-09T18:23:31.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[50486]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]': finished 2026-03-09T18:23:31.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[50486]: from='osd.5 [v2:192.168.123.103:6808/3715823931,v1:192.168.123.103:6809/3715823931]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:31.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[50486]: osdmap e31: 6 total, 5 up, 6 in 2026-03-09T18:23:31.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:31.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[50486]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:31.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:23:31.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:23:31.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:31.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[56210]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 100 GiB / 100 GiB avail; 60 KiB/s, 0 objects/s recovering 2026-03-09T18:23:31.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[56210]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["5"]}]': finished 2026-03-09T18:23:31.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[56210]: from='osd.5 [v2:192.168.123.103:6808/3715823931,v1:192.168.123.103:6809/3715823931]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:31.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[56210]: osdmap e31: 6 total, 5 up, 6 in 2026-03-09T18:23:31.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:31.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[56210]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:31.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:23:31.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:23:31.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:31 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:32.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[50486]: from='client.14334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm03:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:23:32.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[50486]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm03", "root=default"]}]': finished 2026-03-09T18:23:32.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[50486]: osdmap e32: 6 total, 5 up, 6 in 2026-03-09T18:23:32.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:32.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/4240655662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84e5e6e3-e6be-4236-9747-322cb8ca6dd4"}]: dispatch 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[50486]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84e5e6e3-e6be-4236-9747-322cb8ca6dd4"}]: dispatch 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[50486]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84e5e6e3-e6be-4236-9747-322cb8ca6dd4"}]': finished 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[50486]: osd.5 [v2:192.168.123.103:6808/3715823931,v1:192.168.123.103:6809/3715823931] boot 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[50486]: osdmap e33: 7 total, 6 up, 7 in 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[56210]: from='client.14334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm03:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[56210]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm03", "root=default"]}]': finished 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[56210]: osdmap e32: 6 total, 5 up, 6 in 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/4240655662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84e5e6e3-e6be-4236-9747-322cb8ca6dd4"}]: dispatch 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[56210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84e5e6e3-e6be-4236-9747-322cb8ca6dd4"}]: dispatch 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[56210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84e5e6e3-e6be-4236-9747-322cb8ca6dd4"}]': finished 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[56210]: osd.5 [v2:192.168.123.103:6808/3715823931,v1:192.168.123.103:6809/3715823931] boot 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[56210]: osdmap e33: 7 total, 6 up, 7 in 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:32.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:32 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:32.451 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:32 vm03 ceph-mon[54135]: from='client.14334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm03:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:23:32.451 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:32 vm03 ceph-mon[54135]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0195, "args": ["host=vm03", "root=default"]}]': finished 2026-03-09T18:23:32.451 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:32 vm03 ceph-mon[54135]: osdmap e32: 6 total, 5 up, 6 in 2026-03-09T18:23:32.451 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:32 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:32.451 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:32 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:32.451 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:32 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/4240655662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84e5e6e3-e6be-4236-9747-322cb8ca6dd4"}]: dispatch 2026-03-09T18:23:32.451 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:32 vm03 ceph-mon[54135]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84e5e6e3-e6be-4236-9747-322cb8ca6dd4"}]: dispatch 2026-03-09T18:23:32.451 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:32 vm03 ceph-mon[54135]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84e5e6e3-e6be-4236-9747-322cb8ca6dd4"}]': finished 2026-03-09T18:23:32.451 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:32 vm03 ceph-mon[54135]: osd.5 [v2:192.168.123.103:6808/3715823931,v1:192.168.123.103:6809/3715823931] boot 2026-03-09T18:23:32.451 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:32 vm03 ceph-mon[54135]: osdmap e33: 7 total, 6 up, 7 in 2026-03-09T18:23:32.451 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:32 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:23:32.451 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:32 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:33.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:33 vm02 ceph-mon[50486]: purged_snaps scrub starts 2026-03-09T18:23:33.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:33 vm02 ceph-mon[50486]: purged_snaps scrub ok 2026-03-09T18:23:33.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:33 vm02 ceph-mon[50486]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 100 GiB / 100 GiB avail 2026-03-09T18:23:33.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:33 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/1394093642' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:23:33.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:33 vm02 ceph-mon[50486]: osdmap e34: 7 total, 6 up, 7 in 2026-03-09T18:23:33.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:33 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:33.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:33 vm02 ceph-mon[56210]: purged_snaps scrub starts 2026-03-09T18:23:33.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:33 vm02 ceph-mon[56210]: purged_snaps scrub ok 2026-03-09T18:23:33.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:33 vm02 ceph-mon[56210]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 100 GiB / 100 GiB avail 2026-03-09T18:23:33.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:33 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/1394093642' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:23:33.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:33 vm02 ceph-mon[56210]: osdmap e34: 7 total, 6 up, 7 in 2026-03-09T18:23:33.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:33 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:33.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:33 vm03 ceph-mon[54135]: purged_snaps scrub starts 2026-03-09T18:23:33.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:33 vm03 ceph-mon[54135]: purged_snaps scrub ok 2026-03-09T18:23:33.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:33 vm03 ceph-mon[54135]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 100 GiB / 100 GiB avail 2026-03-09T18:23:33.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:33 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/1394093642' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:23:33.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:33 vm03 ceph-mon[54135]: osdmap e34: 7 total, 6 up, 7 in 2026-03-09T18:23:33.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:33 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:35.217 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:34 vm03 ceph-mon[54135]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:35.217 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:34 vm03 ceph-mon[54135]: osdmap e35: 7 total, 6 up, 7 in 2026-03-09T18:23:35.217 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:34 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:35.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:34 vm02 ceph-mon[50486]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:35.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:34 vm02 ceph-mon[50486]: osdmap e35: 7 total, 6 up, 7 in 2026-03-09T18:23:35.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:34 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:35.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:34 vm02 ceph-mon[56210]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:35.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:34 vm02 ceph-mon[56210]: osdmap e35: 7 total, 6 up, 7 in 2026-03-09T18:23:35.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:34 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:36.941 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:36 vm03 ceph-mon[54135]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:36.941 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:36 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:36.941 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:36 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:36.941 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:36 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:36.941 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:36 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:36.941 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:36 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:36.941 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:36 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:36.941 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:36 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:37.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[50486]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:37.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:37.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:37.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:37.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:37.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:37.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:37.106 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:37.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[56210]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:37.106 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:37.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:37.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:37.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:37.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:37.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:37.107 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:36 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:37.915 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:37 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:37.915 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:37 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:37.915 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:37 vm03 ceph-mon[54135]: Detected new or changed devices on vm03 2026-03-09T18:23:37.915 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:37 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:37.915 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:37 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:37.915 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:37 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:37.915 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:37 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:37.915 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:37 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:37.915 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:37 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-03-09T18:23:37.915 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:37 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:38.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:38.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:38.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[50486]: Detected new or changed devices on vm03 2026-03-09T18:23:38.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:38.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:38.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:38.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:38.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:38.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-03-09T18:23:38.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:38.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:38.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:38.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[56210]: Detected new or changed devices on vm03 2026-03-09T18:23:38.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:38.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:38.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:38.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:38.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:38.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-03-09T18:23:38.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:37 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:38.937 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:38 vm03 ceph-mon[54135]: Deploying daemon osd.6 on vm03 2026-03-09T18:23:38.937 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:38 vm03 ceph-mon[54135]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:39.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:38 vm02 ceph-mon[50486]: Deploying daemon osd.6 on vm03 2026-03-09T18:23:39.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:38 vm02 ceph-mon[50486]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:39.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:38 vm02 ceph-mon[56210]: Deploying daemon osd.6 on vm03 2026-03-09T18:23:39.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:38 vm02 ceph-mon[56210]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:41.004 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:40 vm03 ceph-mon[54135]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:41.004 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:40 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:41.004 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:40 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:41.004 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:40 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:41.004 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:40 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:41.004 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:40 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:41.004 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:40 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:41.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:40 vm02 ceph-mon[50486]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:41.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:40 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:41.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:40 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:41.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:40 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:41.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:40 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:41.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:40 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:41.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:40 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:41.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:40 vm02 ceph-mon[56210]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:41.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:40 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:41.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:40 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:41.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:40 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:41.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:40 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:41.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:40 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:41.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:40 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:41.978 INFO:teuthology.orchestra.run.vm03.stdout:Created osd(s) 6 on host 'vm03' 2026-03-09T18:23:42.138 DEBUG:teuthology.orchestra.run.vm03:osd.6> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.6.service 2026-03-09T18:23:42.139 INFO:tasks.cephadm:Deploying osd.7 on vm03 with /dev/nvme0n1... 2026-03-09T18:23:42.139 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- lvm zap /dev/nvme0n1 2026-03-09T18:23:42.202 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:41 vm03 ceph-mon[54135]: from='osd.6 [v2:192.168.123.103:6816/734423527,v1:192.168.123.103:6817/734423527]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]: dispatch 2026-03-09T18:23:42.202 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:41 vm03 ceph-mon[54135]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]: dispatch 2026-03-09T18:23:42.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:41 vm02 ceph-mon[50486]: from='osd.6 [v2:192.168.123.103:6816/734423527,v1:192.168.123.103:6817/734423527]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]: dispatch 2026-03-09T18:23:42.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:41 vm02 ceph-mon[50486]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]: dispatch 2026-03-09T18:23:42.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:41 vm02 ceph-mon[56210]: from='osd.6 [v2:192.168.123.103:6816/734423527,v1:192.168.123.103:6817/734423527]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]: dispatch 2026-03-09T18:23:42.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:41 vm02 ceph-mon[56210]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]: dispatch 2026-03-09T18:23:42.357 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:23:42.953 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:42 vm03 ceph-mon[54135]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:42.954 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:42 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:42.954 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:42 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:42.954 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:42 vm03 ceph-mon[54135]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]': finished 2026-03-09T18:23:43.003 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:23:42 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:23:42.965+0000 7f09435e6640 -1 osd.6 0 waiting for initial osdmap 2026-03-09T18:23:43.003 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:23:42 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:23:42.971+0000 7f093f410640 -1 osd.6 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T18:23:43.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:42 vm03 ceph-mon[54135]: from='osd.6 [v2:192.168.123.103:6816/734423527,v1:192.168.123.103:6817/734423527]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:43.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:42 vm03 ceph-mon[54135]: osdmap e36: 7 total, 6 up, 7 in 2026-03-09T18:23:43.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:42 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:43.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:42 vm03 ceph-mon[54135]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:43.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:42 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:43.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:42 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:43.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:42 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:43.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:42 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:43.003 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:42 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:43.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[50486]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:43.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:43.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:43.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[50486]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]': finished 2026-03-09T18:23:43.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[50486]: from='osd.6 [v2:192.168.123.103:6816/734423527,v1:192.168.123.103:6817/734423527]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:43.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[50486]: osdmap e36: 7 total, 6 up, 7 in 2026-03-09T18:23:43.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:43.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[50486]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:43.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:43.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:43.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:43.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:43.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:43.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[56210]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:43.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:43.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:43.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[56210]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["6"]}]': finished 2026-03-09T18:23:43.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[56210]: from='osd.6 [v2:192.168.123.103:6816/734423527,v1:192.168.123.103:6817/734423527]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:43.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[56210]: osdmap e36: 7 total, 6 up, 7 in 2026-03-09T18:23:43.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:43.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[56210]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:43.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:43.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:43.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:43.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:43.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:42 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:43.421 INFO:teuthology.orchestra.run.vm03.stdout: 2026-03-09T18:23:43.436 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch daemon add osd vm03:/dev/nvme0n1 2026-03-09T18:23:43.668 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:23:44.201 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:43 vm03 ceph-mon[54135]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm03", "root=default"]}]': finished 2026-03-09T18:23:44.201 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:43 vm03 ceph-mon[54135]: osdmap e37: 7 total, 6 up, 7 in 2026-03-09T18:23:44.201 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:43 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:44.201 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:43 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:44.201 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:43 vm03 ceph-mon[54135]: osd.6 [v2:192.168.123.103:6816/734423527,v1:192.168.123.103:6817/734423527] boot 2026-03-09T18:23:44.201 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:43 vm03 ceph-mon[54135]: osdmap e38: 7 total, 7 up, 7 in 2026-03-09T18:23:44.201 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:43 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:44.201 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:43 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:23:44.201 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:43 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:23:44.201 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:43 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[50486]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm03", "root=default"]}]': finished 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[50486]: osdmap e37: 7 total, 6 up, 7 in 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[50486]: osd.6 [v2:192.168.123.103:6816/734423527,v1:192.168.123.103:6817/734423527] boot 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[50486]: osdmap e38: 7 total, 7 up, 7 in 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[56210]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0195, "args": ["host=vm03", "root=default"]}]': finished 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[56210]: osdmap e37: 7 total, 6 up, 7 in 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[56210]: osd.6 [v2:192.168.123.103:6816/734423527,v1:192.168.123.103:6817/734423527] boot 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[56210]: osdmap e38: 7 total, 7 up, 7 in 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-03-09T18:23:44.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:43 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:45.024 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:44 vm03 ceph-mon[54135]: purged_snaps scrub starts 2026-03-09T18:23:45.025 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:44 vm03 ceph-mon[54135]: purged_snaps scrub ok 2026-03-09T18:23:45.025 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:44 vm03 ceph-mon[54135]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:45.025 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:44 vm03 ceph-mon[54135]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm03:/dev/nvme0n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:23:45.025 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:44 vm03 ceph-mon[54135]: osdmap e39: 7 total, 7 up, 7 in 2026-03-09T18:23:45.025 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:44 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/144128914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2a6ef2-5b1d-4dc5-986f-b8a8d26365dc"}]: dispatch 2026-03-09T18:23:45.025 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:44 vm03 ceph-mon[54135]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2a6ef2-5b1d-4dc5-986f-b8a8d26365dc"}]: dispatch 2026-03-09T18:23:45.025 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:44 vm03 ceph-mon[54135]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c2a6ef2-5b1d-4dc5-986f-b8a8d26365dc"}]': finished 2026-03-09T18:23:45.025 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:44 vm03 ceph-mon[54135]: osdmap e40: 8 total, 7 up, 8 in 2026-03-09T18:23:45.025 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:44 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[50486]: purged_snaps scrub starts 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[50486]: purged_snaps scrub ok 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[50486]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[50486]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm03:/dev/nvme0n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[50486]: osdmap e39: 7 total, 7 up, 7 in 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/144128914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2a6ef2-5b1d-4dc5-986f-b8a8d26365dc"}]: dispatch 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[50486]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2a6ef2-5b1d-4dc5-986f-b8a8d26365dc"}]: dispatch 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[50486]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c2a6ef2-5b1d-4dc5-986f-b8a8d26365dc"}]': finished 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[50486]: osdmap e40: 8 total, 7 up, 8 in 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[56210]: purged_snaps scrub starts 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[56210]: purged_snaps scrub ok 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[56210]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 120 GiB / 120 GiB avail 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[56210]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "vm03:/dev/nvme0n1", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[56210]: osdmap e39: 7 total, 7 up, 7 in 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/144128914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2a6ef2-5b1d-4dc5-986f-b8a8d26365dc"}]: dispatch 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[56210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2a6ef2-5b1d-4dc5-986f-b8a8d26365dc"}]: dispatch 2026-03-09T18:23:45.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[56210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c2a6ef2-5b1d-4dc5-986f-b8a8d26365dc"}]': finished 2026-03-09T18:23:45.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[56210]: osdmap e40: 8 total, 7 up, 8 in 2026-03-09T18:23:45.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:44 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:46.134 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:45 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/2856481298' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:23:46.135 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:45 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/2856481298' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:23:46.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:45 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/2856481298' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-03-09T18:23:47.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:46 vm03 ceph-mon[54135]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:47.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:46 vm02 ceph-mon[50486]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:47.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:46 vm02 ceph-mon[56210]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:49.186 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:48 vm03 ceph-mon[54135]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:49.186 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:48 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:49.186 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:48 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:49.186 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:48 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:49.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:48 vm02 ceph-mon[50486]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:49.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:48 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:49.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:48 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:49.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:48 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:49.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:48 vm02 ceph-mon[56210]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:49.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:48 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:49.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:48 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:49.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:48 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:50.136 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:50 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-03-09T18:23:50.136 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:50 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:50.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-03-09T18:23:50.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:50 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:50.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:50 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-03-09T18:23:50.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:50 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:51.278 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:51 vm03 ceph-mon[54135]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:51.278 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:51 vm03 ceph-mon[54135]: Deploying daemon osd.7 on vm03 2026-03-09T18:23:51.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:51 vm02 ceph-mon[50486]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:51.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:51 vm02 ceph-mon[50486]: Deploying daemon osd.7 on vm03 2026-03-09T18:23:51.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:51 vm02 ceph-mon[56210]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:51.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:51 vm02 ceph-mon[56210]: Deploying daemon osd.7 on vm03 2026-03-09T18:23:53.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:53 vm03 ceph-mon[54135]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:53.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:53 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:53.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:53 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:53.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:53 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:53.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:53 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:53.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:53 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:53.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:53 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:53.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:53 vm02 ceph-mon[50486]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:53.367 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:53 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:53.367 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:53 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:53.367 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:53 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:53.367 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:53 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:53.367 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:53 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:53.368 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:53 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:53.368 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:53 vm02 ceph-mon[56210]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:53.368 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:53 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:53.368 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:53 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:53.368 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:53 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:53.368 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:53 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:53.368 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:53 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:53.368 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:53 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:54.235 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:54 vm03 ceph-mon[54135]: from='osd.7 [v2:192.168.123.103:6824/2163349677,v1:192.168.123.103:6825/2163349677]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]: dispatch 2026-03-09T18:23:54.235 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:54 vm03 ceph-mon[54135]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]: dispatch 2026-03-09T18:23:54.282 INFO:teuthology.orchestra.run.vm03.stdout:Created osd(s) 7 on host 'vm03' 2026-03-09T18:23:54.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:54 vm02 ceph-mon[50486]: from='osd.7 [v2:192.168.123.103:6824/2163349677,v1:192.168.123.103:6825/2163349677]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]: dispatch 2026-03-09T18:23:54.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:54 vm02 ceph-mon[50486]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]: dispatch 2026-03-09T18:23:54.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:54 vm02 ceph-mon[56210]: from='osd.7 [v2:192.168.123.103:6824/2163349677,v1:192.168.123.103:6825/2163349677]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]: dispatch 2026-03-09T18:23:54.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:54 vm02 ceph-mon[56210]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]: dispatch 2026-03-09T18:23:54.448 DEBUG:teuthology.orchestra.run.vm03:osd.7> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.7.service 2026-03-09T18:23:54.449 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2026-03-09T18:23:54.449 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd stat -f json 2026-03-09T18:23:54.646 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:23:54.906 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:23:55.105 INFO:teuthology.orchestra.run.vm02.stdout:{"epoch":41,"num_osds":8,"num_up_osds":7,"osd_up_since":1773080623,"num_in_osds":8,"osd_in_since":1773080624,"num_remapped_pgs":0} 2026-03-09T18:23:55.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[50486]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:55.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[50486]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]': finished 2026-03-09T18:23:55.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[50486]: osdmap e41: 8 total, 7 up, 8 in 2026-03-09T18:23:55.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:55.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[50486]: from='osd.7 [v2:192.168.123.103:6824/2163349677,v1:192.168.123.103:6825/2163349677]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:55.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[50486]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:55.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:55.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:55.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1468300432' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[56210]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[56210]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]': finished 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[56210]: osdmap e41: 8 total, 7 up, 8 in 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[56210]: from='osd.7 [v2:192.168.123.103:6824/2163349677,v1:192.168.123.103:6825/2163349677]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[56210]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:55.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:55 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1468300432' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T18:23:55.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:55 vm03 ceph-mon[54135]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:55.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:55 vm03 ceph-mon[54135]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["7"]}]': finished 2026-03-09T18:23:55.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:55 vm03 ceph-mon[54135]: osdmap e41: 8 total, 7 up, 8 in 2026-03-09T18:23:55.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:55 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:55.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:55 vm03 ceph-mon[54135]: from='osd.7 [v2:192.168.123.103:6824/2163349677,v1:192.168.123.103:6825/2163349677]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:55.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:55 vm03 ceph-mon[54135]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm03", "root=default"]}]: dispatch 2026-03-09T18:23:55.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:55 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:55.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:55 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:23:55.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:55 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:55.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:55 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:55.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:55 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:55.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:55 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:55.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:55 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:55.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:55 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1468300432' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T18:23:56.106 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd stat -f json 2026-03-09T18:23:56.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:56 vm03 ceph-mon[54135]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm03", "root=default"]}]': finished 2026-03-09T18:23:56.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:56 vm03 ceph-mon[54135]: osdmap e42: 8 total, 7 up, 8 in 2026-03-09T18:23:56.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:56 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:56.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:56 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:56.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:56 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:56.253 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:23:56 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:23:56.112+0000 7fe000142640 -1 osd.7 0 waiting for initial osdmap 2026-03-09T18:23:56.254 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:23:56 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:23:56.129+0000 7fdffb76b640 -1 osd.7 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-03-09T18:23:56.309 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:23:56.340 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:56 vm02 ceph-mon[50486]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm03", "root=default"]}]': finished 2026-03-09T18:23:56.340 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:56 vm02 ceph-mon[50486]: osdmap e42: 8 total, 7 up, 8 in 2026-03-09T18:23:56.340 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:56 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:56.340 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:56 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:56.340 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:56 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:56.340 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:56 vm02 ceph-mon[56210]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0195, "args": ["host=vm03", "root=default"]}]': finished 2026-03-09T18:23:56.340 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:56 vm02 ceph-mon[56210]: osdmap e42: 8 total, 7 up, 8 in 2026-03-09T18:23:56.341 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:56 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:56.341 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:56 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:56.341 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:56 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:56.569 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:23:56.749 INFO:teuthology.orchestra.run.vm02.stdout:{"epoch":43,"num_osds":8,"num_up_osds":7,"osd_up_since":1773080623,"num_in_osds":8,"osd_in_since":1773080624,"num_remapped_pgs":1} 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: purged_snaps scrub starts 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: purged_snaps scrub ok 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: osdmap e43: 8 total, 7 up, 8 in 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: from='osd.7 ' entity='osd.7' 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3262350913' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:57.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: purged_snaps scrub starts 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: purged_snaps scrub ok 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: osdmap e43: 8 total, 7 up, 8 in 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: from='osd.7 ' entity='osd.7' 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3262350913' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:57.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:57 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: purged_snaps scrub starts 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: purged_snaps scrub ok 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: osdmap e43: 8 total, 7 up, 8 in 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: from='osd.7 ' entity='osd.7' 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3262350913' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:57.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:57 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:57.750 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd stat -f json 2026-03-09T18:23:57.939 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:23:58.193 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:23:58.345 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[50486]: Detected new or changed devices on vm03 2026-03-09T18:23:58.345 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[50486]: osd.7 [v2:192.168.123.103:6824/2163349677,v1:192.168.123.103:6825/2163349677] boot 2026-03-09T18:23:58.345 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[50486]: osdmap e44: 8 total, 8 up, 8 in 2026-03-09T18:23:58.345 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:58.345 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[50486]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:58.345 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:58.345 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[56210]: Detected new or changed devices on vm03 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[56210]: osd.7 [v2:192.168.123.103:6824/2163349677,v1:192.168.123.103:6825/2163349677] boot 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[56210]: osdmap e44: 8 total, 8 up, 8 in 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[56210]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:58.346 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:58 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:58.390 INFO:teuthology.orchestra.run.vm02.stdout:{"epoch":45,"num_osds":8,"num_up_osds":8,"osd_up_since":1773080637,"num_in_osds":8,"osd_in_since":1773080624,"num_remapped_pgs":0} 2026-03-09T18:23:58.390 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd dump --format=json 2026-03-09T18:23:58.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:58 vm03 ceph-mon[54135]: Detected new or changed devices on vm03 2026-03-09T18:23:58.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:58 vm03 ceph-mon[54135]: osd.7 [v2:192.168.123.103:6824/2163349677,v1:192.168.123.103:6825/2163349677] boot 2026-03-09T18:23:58.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:58 vm03 ceph-mon[54135]: osdmap e44: 8 total, 8 up, 8 in 2026-03-09T18:23:58.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:58 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:23:58.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:58 vm03 ceph-mon[54135]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 140 GiB / 140 GiB avail 2026-03-09T18:23:58.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:58 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:58.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:58 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:58.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:58 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:23:58.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:58 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:23:58.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:58 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:23:58.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:58 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:58.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:58 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:23:58.585 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:23:58.845 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:23:58.845 INFO:teuthology.orchestra.run.vm02.stdout:{"epoch":45,"fsid":"a3515824-1be4-11f1-b292-f5e4728bca3d","created":"2026-03-09T18:21:21.876887+0000","modified":"2026-03-09T18:23:58.084893+0000","last_up_change":"2026-03-09T18:23:57.068842+0000","last_in_change":"2026-03-09T18:23:44.959340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-09T18:22:56.382179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fed479aa-8268-4fe5-8e7c-7c393735e28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6802","nonce":201462935},{"type":"v1","addr":"192.168.123.102:6803","nonce":201462935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6804","nonce":201462935},{"type":"v1","addr":"192.168.123.102:6805","nonce":201462935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6808","nonce":201462935},{"type":"v1","addr":"192.168.123.102:6809","nonce":201462935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6806","nonce":201462935},{"type":"v1","addr":"192.168.123.102:6807","nonce":201462935}]},"public_addr":"192.168.123.102:6803/201462935","cluster_addr":"192.168.123.102:6805/201462935","heartbeat_back_addr":"192.168.123.102:6809/201462935","heartbeat_front_addr":"192.168.123.102:6807/201462935","state":["exists","up"]},{"osd":1,"uuid":"1736e6d8-0962-4235-9bc7-ee9697be5f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6810","nonce":1304575059},{"type":"v1","addr":"192.168.123.102:6811","nonce":1304575059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6812","nonce":1304575059},{"type":"v1","addr":"192.168.123.102:6813","nonce":1304575059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6816","nonce":1304575059},{"type":"v1","addr":"192.168.123.102:6817","nonce":1304575059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6814","nonce":1304575059},{"type":"v1","addr":"192.168.123.102:6815","nonce":1304575059}]},"public_addr":"192.168.123.102:6811/1304575059","cluster_addr":"192.168.123.102:6813/1304575059","heartbeat_back_addr":"192.168.123.102:6817/1304575059","heartbeat_front_addr":"192.168.123.102:6815/1304575059","state":["exists","up"]},{"osd":2,"uuid":"0e2314f8-be12-474e-a11e-3d5d46cc8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6818","nonce":1444582995},{"type":"v1","addr":"192.168.123.102:6819","nonce":1444582995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6820","nonce":1444582995},{"type":"v1","addr":"192.168.123.102:6821","nonce":1444582995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6824","nonce":1444582995},{"type":"v1","addr":"192.168.123.102:6825","nonce":1444582995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6822","nonce":1444582995},{"type":"v1","addr":"192.168.123.102:6823","nonce":1444582995}]},"public_addr":"192.168.123.102:6819/1444582995","cluster_addr":"192.168.123.102:6821/1444582995","heartbeat_back_addr":"192.168.123.102:6825/1444582995","heartbeat_front_addr":"192.168.123.102:6823/1444582995","state":["exists","up"]},{"osd":3,"uuid":"5388e10f-3054-4eea-a54e-1a6b4abe8a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6826","nonce":3447875147},{"type":"v1","addr":"192.168.123.102:6827","nonce":3447875147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6828","nonce":3447875147},{"type":"v1","addr":"192.168.123.102:6829","nonce":3447875147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6832","nonce":3447875147},{"type":"v1","addr":"192.168.123.102:6833","nonce":3447875147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6830","nonce":3447875147},{"type":"v1","addr":"192.168.123.102:6831","nonce":3447875147}]},"public_addr":"192.168.123.102:6827/3447875147","cluster_addr":"192.168.123.102:6829/3447875147","heartbeat_back_addr":"192.168.123.102:6833/3447875147","heartbeat_front_addr":"192.168.123.102:6831/3447875147","state":["exists","up"]},{"osd":4,"uuid":"c4b55510-663a-4d2f-8c08-7f66cc8c0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6800","nonce":4190956836},{"type":"v1","addr":"192.168.123.103:6801","nonce":4190956836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6802","nonce":4190956836},{"type":"v1","addr":"192.168.123.103:6803","nonce":4190956836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6806","nonce":4190956836},{"type":"v1","addr":"192.168.123.103:6807","nonce":4190956836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6804","nonce":4190956836},{"type":"v1","addr":"192.168.123.103:6805","nonce":4190956836}]},"public_addr":"192.168.123.103:6801/4190956836","cluster_addr":"192.168.123.103:6803/4190956836","heartbeat_back_addr":"192.168.123.103:6807/4190956836","heartbeat_front_addr":"192.168.123.103:6805/4190956836","state":["exists","up"]},{"osd":5,"uuid":"8af9ca3d-6e5b-4912-a874-64153fae561a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6808","nonce":3715823931},{"type":"v1","addr":"192.168.123.103:6809","nonce":3715823931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6810","nonce":3715823931},{"type":"v1","addr":"192.168.123.103:6811","nonce":3715823931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6814","nonce":3715823931},{"type":"v1","addr":"192.168.123.103:6815","nonce":3715823931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6812","nonce":3715823931},{"type":"v1","addr":"192.168.123.103:6813","nonce":3715823931}]},"public_addr":"192.168.123.103:6809/3715823931","cluster_addr":"192.168.123.103:6811/3715823931","heartbeat_back_addr":"192.168.123.103:6815/3715823931","heartbeat_front_addr":"192.168.123.103:6813/3715823931","state":["exists","up"]},{"osd":6,"uuid":"84e5e6e3-e6be-4236-9747-322cb8ca6dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6816","nonce":734423527},{"type":"v1","addr":"192.168.123.103:6817","nonce":734423527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6818","nonce":734423527},{"type":"v1","addr":"192.168.123.103:6819","nonce":734423527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6822","nonce":734423527},{"type":"v1","addr":"192.168.123.103:6823","nonce":734423527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6820","nonce":734423527},{"type":"v1","addr":"192.168.123.103:6821","nonce":734423527}]},"public_addr":"192.168.123.103:6817/734423527","cluster_addr":"192.168.123.103:6819/734423527","heartbeat_back_addr":"192.168.123.103:6823/734423527","heartbeat_front_addr":"192.168.123.103:6821/734423527","state":["exists","up"]},{"osd":7,"uuid":"6c2a6ef2-5b1d-4dc5-986f-b8a8d26365dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6824","nonce":2163349677},{"type":"v1","addr":"192.168.123.103:6825","nonce":2163349677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6826","nonce":2163349677},{"type":"v1","addr":"192.168.123.103:6827","nonce":2163349677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6830","nonce":2163349677},{"type":"v1","addr":"192.168.123.103:6831","nonce":2163349677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6828","nonce":2163349677},{"type":"v1","addr":"192.168.123.103:6829","nonce":2163349677}]},"public_addr":"192.168.123.103:6825/2163349677","cluster_addr":"192.168.123.103:6827/2163349677","heartbeat_back_addr":"192.168.123.103:6831/2163349677","heartbeat_front_addr":"192.168.123.103:6829/2163349677","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:22:26.795858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:22:39.381354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:22:52.805980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:04.905995+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:16.913642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:30.133397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:42.759151+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:54.878585+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.123.102:6800/2636160183":"2026-03-10T18:21:46.312647+0000","192.168.123.102:0/2773773004":"2026-03-10T18:21:46.312647+0000","192.168.123.102:0/759769202":"2026-03-10T18:21:46.312647+0000","192.168.123.102:0/3939506746":"2026-03-10T18:21:46.312647+0000","192.168.123.102:6801/2636160183":"2026-03-10T18:21:46.312647+0000","192.168.123.102:0/1875777209":"2026-03-10T18:21:34.217391+0000","192.168.123.102:0/2162226603":"2026-03-10T18:21:34.217391+0000","192.168.123.102:0/932629632":"2026-03-10T18:21:34.217391+0000","192.168.123.102:6801/51601173":"2026-03-10T18:21:34.217391+0000","192.168.123.102:6800/51601173":"2026-03-10T18:21:34.217391+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-09T18:23:59.008 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-03-09T18:22:56.382179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-03-09T18:23:59.009 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd pool get .mgr pg_num 2026-03-09T18:23:59.221 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:23:59.247 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:59 vm02 ceph-mon[50486]: osdmap e45: 8 total, 8 up, 8 in 2026-03-09T18:23:59.247 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:59 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3409293466' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T18:23:59.247 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:23:59 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1560957349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T18:23:59.247 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:59 vm02 ceph-mon[56210]: osdmap e45: 8 total, 8 up, 8 in 2026-03-09T18:23:59.247 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:59 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3409293466' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T18:23:59.247 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:23:59 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1560957349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T18:23:59.469 INFO:teuthology.orchestra.run.vm02.stdout:pg_num: 1 2026-03-09T18:23:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:59 vm03 ceph-mon[54135]: osdmap e45: 8 total, 8 up, 8 in 2026-03-09T18:23:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3409293466' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-03-09T18:23:59.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:23:59 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1560957349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T18:23:59.648 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on vm02 2026-03-09T18:23:59.648 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch apply rgw foo.a --placement '1;vm02=foo.a' 2026-03-09T18:23:59.842 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:24:00.136 INFO:teuthology.orchestra.run.vm03.stdout:Scheduled rgw.foo.a update... 2026-03-09T18:24:00.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:00 vm03 ceph-mon[54135]: osdmap e46: 8 total, 8 up, 8 in 2026-03-09T18:24:00.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:00 vm03 ceph-mon[54135]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:00.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:00 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/2875998864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-03-09T18:24:00.316 DEBUG:teuthology.orchestra.run.vm02:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@rgw.foo.a.service 2026-03-09T18:24:00.319 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on vm03 2026-03-09T18:24:00.319 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd pool create datapool 3 3 replicated 2026-03-09T18:24:00.401 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:00 vm02 ceph-mon[50486]: osdmap e46: 8 total, 8 up, 8 in 2026-03-09T18:24:00.401 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:00 vm02 ceph-mon[50486]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:00.401 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:00 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/2875998864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-03-09T18:24:00.401 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:00 vm02 ceph-mon[56210]: osdmap e46: 8 total, 8 up, 8 in 2026-03-09T18:24:00.401 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:00 vm02 ceph-mon[56210]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:00.401 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:00 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/2875998864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-03-09T18:24:00.519 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:24:01.163 INFO:teuthology.orchestra.run.vm03.stderr:pool 'datapool' created 2026-03-09T18:24:01.334 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- rbd pool init datapool 2026-03-09T18:24:01.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[50486]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;vm02=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[50486]: Saving service rgw.foo.a spec with placement vm02=foo.a;count:1 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[50486]: Deploying daemon rgw.foo.a on vm02 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/4044630' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[50486]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[56210]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;vm02=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[56210]: Saving service rgw.foo.a spec with placement vm02=foo.a;count:1 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[56210]: Deploying daemon rgw.foo.a on vm02 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/4044630' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:01 vm02 ceph-mon[56210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2026-03-09T18:24:01.357 INFO:journalctl@ceph.rgw.foo.a.vm02.stdout:Mar 09 18:24:01 vm02 systemd[1]: Started Ceph rgw.foo.a for a3515824-1be4-11f1-b292-f5e4728bca3d. 2026-03-09T18:24:01.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:01 vm03 ceph-mon[54135]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;vm02=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:01.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:01 vm03 ceph-mon[54135]: Saving service rgw.foo.a spec with placement vm02=foo.a;count:1 2026-03-09T18:24:01.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:01 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:01.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:01 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:01.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:01 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:01.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:01 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:01.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:01 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:01.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:01 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2026-03-09T18:24:01.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:01 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2026-03-09T18:24:01.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:01 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:01.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:01 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:01.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:01 vm03 ceph-mon[54135]: Deploying daemon rgw.foo.a on vm02 2026-03-09T18:24:01.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:01 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/4044630' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2026-03-09T18:24:01.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:01 vm03 ceph-mon[54135]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2026-03-09T18:24:01.523 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:24:02.332 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2026-03-09T18:24:02.332 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: osdmap e47: 8 total, 8 up, 8 in 2026-03-09T18:24:02.332 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.332 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: Saving service rgw.foo.a spec with placement vm02=foo.a;count:1 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: Checking dashboard <-> RGW credentials 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: pgmap v110: 4 pgs: 3 unknown, 1 active+clean; 577 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/796639672' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[50486]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: osdmap e47: 8 total, 8 up, 8 in 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: Saving service rgw.foo.a spec with placement vm02=foo.a;count:1 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: Checking dashboard <-> RGW credentials 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: pgmap v110: 4 pgs: 3 unknown, 1 active+clean; 577 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/796639672' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2026-03-09T18:24:02.333 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:02 vm02 ceph-mon[56210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2026-03-09T18:24:02.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2026-03-09T18:24:02.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: osdmap e47: 8 total, 8 up, 8 in 2026-03-09T18:24:02.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: Saving service rgw.foo.a spec with placement vm02=foo.a;count:1 2026-03-09T18:24:02.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:02.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:02.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:02.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:02.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: Checking dashboard <-> RGW credentials 2026-03-09T18:24:02.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: pgmap v110: 4 pgs: 3 unknown, 1 active+clean; 577 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:02.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/796639672' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2026-03-09T18:24:02.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:02 vm03 ceph-mon[54135]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2026-03-09T18:24:03.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:03 vm02 ceph-mon[50486]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2026-03-09T18:24:03.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:03 vm02 ceph-mon[50486]: osdmap e48: 8 total, 8 up, 8 in 2026-03-09T18:24:03.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:03 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/4018012336' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2026-03-09T18:24:03.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:03 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1398059147' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2026-03-09T18:24:03.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:03 vm02 ceph-mon[50486]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-03-09T18:24:03.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:03 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:03.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:03 vm02 ceph-mon[56210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2026-03-09T18:24:03.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:03 vm02 ceph-mon[56210]: osdmap e48: 8 total, 8 up, 8 in 2026-03-09T18:24:03.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:03 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/4018012336' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2026-03-09T18:24:03.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:03 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1398059147' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2026-03-09T18:24:03.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:03 vm02 ceph-mon[56210]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-03-09T18:24:03.356 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:03 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:03.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:03 vm03 ceph-mon[54135]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2026-03-09T18:24:03.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:03 vm03 ceph-mon[54135]: osdmap e48: 8 total, 8 up, 8 in 2026-03-09T18:24:03.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:03 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/4018012336' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2026-03-09T18:24:03.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:03 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1398059147' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2026-03-09T18:24:03.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:03 vm03 ceph-mon[54135]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-03-09T18:24:03.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:03 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:04.354 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 192.168.123.103 --placement '1;vm03=iscsi.a' 2026-03-09T18:24:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:04 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/4018012336' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2026-03-09T18:24:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:04 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1398059147' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2026-03-09T18:24:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:04 vm03 ceph-mon[54135]: osdmap e49: 8 total, 8 up, 8 in 2026-03-09T18:24:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:04 vm03 ceph-mon[54135]: pgmap v113: 36 pgs: 2 active+clean, 13 creating+peering, 21 unknown; 577 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:04 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:04.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:04 vm03 ceph-mon[54135]: osdmap e50: 8 total, 8 up, 8 in 2026-03-09T18:24:04.543 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:24:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/4018012336' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2026-03-09T18:24:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1398059147' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2026-03-09T18:24:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[50486]: osdmap e49: 8 total, 8 up, 8 in 2026-03-09T18:24:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[50486]: pgmap v113: 36 pgs: 2 active+clean, 13 creating+peering, 21 unknown; 577 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:04.606 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[50486]: osdmap e50: 8 total, 8 up, 8 in 2026-03-09T18:24:04.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/4018012336' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2026-03-09T18:24:04.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1398059147' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2026-03-09T18:24:04.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[56210]: osdmap e49: 8 total, 8 up, 8 in 2026-03-09T18:24:04.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:04.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[56210]: pgmap v113: 36 pgs: 2 active+clean, 13 creating+peering, 21 unknown; 577 KiB data, 215 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:04.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:04.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:04.607 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:04 vm02 ceph-mon[56210]: osdmap e50: 8 total, 8 up, 8 in 2026-03-09T18:24:04.808 INFO:teuthology.orchestra.run.vm03.stdout:Scheduled iscsi.datapool update... 2026-03-09T18:24:04.964 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2026-03-09T18:24:04.964 DEBUG:teuthology.orchestra.run.vm02:> set -ex 2026-03-09T18:24:04.964 DEBUG:teuthology.orchestra.run.vm02:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2026-03-09T18:24:04.992 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T18:24:04.993 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2026-03-09T18:24:05.019 DEBUG:teuthology.orchestra.run.vm03:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@iscsi.iscsi.a.service 2026-03-09T18:24:05.062 INFO:tasks.cephadm:Adding prometheus.a on vm03 2026-03-09T18:24:05.062 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch apply prometheus '1;vm03=a' 2026-03-09T18:24:05.313 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:24:05.341 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:05 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3713956150' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T18:24:05.342 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:05 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T18:24:05.342 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:05 vm03 ceph-mon[54135]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T18:24:05.342 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:05 vm03 ceph-mon[54135]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-03-09T18:24:05.342 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:05 vm03 ceph-mon[54135]: Cluster is now healthy 2026-03-09T18:24:05.342 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:05 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:05.342 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:05 vm03 ceph-mon[54135]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "192.168.123.103", "placement": "1;vm03=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:05.342 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:05 vm03 ceph-mon[54135]: Saving service iscsi.datapool spec with placement vm03=iscsi.a;count:1 2026-03-09T18:24:05.342 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:05 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:05.342 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:05 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2026-03-09T18:24:05.342 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:05 vm03 ceph-mon[54135]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2026-03-09T18:24:05.342 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:05 vm03 ceph-mon[54135]: osdmap e51: 8 total, 8 up, 8 in 2026-03-09T18:24:05.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3713956150' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T18:24:05.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T18:24:05.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[50486]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T18:24:05.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[50486]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-03-09T18:24:05.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[50486]: Cluster is now healthy 2026-03-09T18:24:05.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:05.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[50486]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "192.168.123.103", "placement": "1;vm03=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:05.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[50486]: Saving service iscsi.datapool spec with placement vm03=iscsi.a;count:1 2026-03-09T18:24:05.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:05.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2026-03-09T18:24:05.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[50486]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2026-03-09T18:24:05.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[50486]: osdmap e51: 8 total, 8 up, 8 in 2026-03-09T18:24:05.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3713956150' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T18:24:05.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T18:24:05.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[56210]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2026-03-09T18:24:05.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[56210]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-03-09T18:24:05.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[56210]: Cluster is now healthy 2026-03-09T18:24:05.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:05.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[56210]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "192.168.123.103", "placement": "1;vm03=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:05.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[56210]: Saving service iscsi.datapool spec with placement vm03=iscsi.a;count:1 2026-03-09T18:24:05.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:05.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2026-03-09T18:24:05.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[56210]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2026-03-09T18:24:05.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:05 vm02 ceph-mon[56210]: osdmap e51: 8 total, 8 up, 8 in 2026-03-09T18:24:05.594 INFO:teuthology.orchestra.run.vm03.stdout:Scheduled prometheus update... 2026-03-09T18:24:05.781 DEBUG:teuthology.orchestra.run.vm03:prometheus.a> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@prometheus.a.service 2026-03-09T18:24:05.782 INFO:tasks.cephadm:Adding node-exporter.a on vm02 2026-03-09T18:24:05.782 INFO:tasks.cephadm:Adding node-exporter.b on vm03 2026-03-09T18:24:05.782 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch apply node-exporter '2;vm02=a;vm03=b' 2026-03-09T18:24:06.017 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:24:06.299 INFO:teuthology.orchestra.run.vm03.stdout:Scheduled node-exporter update... 2026-03-09T18:24:06.479 DEBUG:teuthology.orchestra.run.vm02:node-exporter.a> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@node-exporter.a.service 2026-03-09T18:24:06.481 DEBUG:teuthology.orchestra.run.vm03:node-exporter.b> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@node-exporter.b.service 2026-03-09T18:24:06.483 INFO:tasks.cephadm:Adding alertmanager.a on vm02 2026-03-09T18:24:06.483 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch apply alertmanager '1;vm02=a' 2026-03-09T18:24:06.714 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:24:06.740 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:06 vm03 ceph-mon[54135]: pgmap v116: 68 pgs: 14 active+clean, 27 creating+peering, 27 unknown; 577 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2026-03-09T18:24:06.740 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:06 vm03 ceph-mon[54135]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;vm03=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:06.740 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:06 vm03 ceph-mon[54135]: Saving service prometheus spec with placement vm03=a;count:1 2026-03-09T18:24:06.740 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:06 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:06.740 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:06 vm03 ceph-mon[54135]: osdmap e52: 8 total, 8 up, 8 in 2026-03-09T18:24:06.740 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:06 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T18:24:06.740 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:06 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3713956150' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T18:24:06.740 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:06 vm03 ceph-mon[54135]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T18:24:06.740 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:06 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:06.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[50486]: pgmap v116: 68 pgs: 14 active+clean, 27 creating+peering, 27 unknown; 577 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2026-03-09T18:24:06.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[50486]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;vm03=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:06.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[50486]: Saving service prometheus spec with placement vm03=a;count:1 2026-03-09T18:24:06.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:06.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[50486]: osdmap e52: 8 total, 8 up, 8 in 2026-03-09T18:24:06.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T18:24:06.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3713956150' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T18:24:06.856 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[50486]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T18:24:06.857 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:06.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[56210]: pgmap v116: 68 pgs: 14 active+clean, 27 creating+peering, 27 unknown; 577 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2026-03-09T18:24:06.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[56210]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;vm03=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:06.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[56210]: Saving service prometheus spec with placement vm03=a;count:1 2026-03-09T18:24:06.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:06.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[56210]: osdmap e52: 8 total, 8 up, 8 in 2026-03-09T18:24:06.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T18:24:06.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3713956150' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T18:24:06.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[56210]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2026-03-09T18:24:06.857 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:06 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:06.983 INFO:teuthology.orchestra.run.vm03.stdout:Scheduled alertmanager update... 2026-03-09T18:24:07.137 DEBUG:teuthology.orchestra.run.vm02:alertmanager.a> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@alertmanager.a.service 2026-03-09T18:24:07.139 INFO:tasks.cephadm:Adding grafana.a on vm03 2026-03-09T18:24:07.140 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph orch apply grafana '1;vm03=a' 2026-03-09T18:24:07.353 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:24:07.619 INFO:teuthology.orchestra.run.vm03.stdout:Scheduled grafana update... 2026-03-09T18:24:07.794 DEBUG:teuthology.orchestra.run.vm03:grafana.a> sudo journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@grafana.a.service 2026-03-09T18:24:07.795 INFO:tasks.cephadm:Setting up client nodes... 2026-03-09T18:24:07.796 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-03-09T18:24:07.976 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:07.984 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:07 vm03 ceph-mon[54135]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;vm02=a;vm03=b", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:07.984 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:07 vm03 ceph-mon[54135]: Saving service node-exporter spec with placement vm02=a;vm03=b;count:2 2026-03-09T18:24:07.984 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:07 vm03 ceph-mon[54135]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;vm02=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[50486]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;vm02=a;vm03=b", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[50486]: Saving service node-exporter spec with placement vm02=a;vm03=b;count:2 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[50486]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;vm02=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[50486]: Saving service alertmanager spec with placement vm02=a;count:1 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[50486]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[50486]: osdmap e53: 8 total, 8 up, 8 in 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[56210]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;vm02=a;vm03=b", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[56210]: Saving service node-exporter spec with placement vm02=a;vm03=b;count:2 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[56210]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;vm02=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[56210]: Saving service alertmanager spec with placement vm02=a;count:1 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[56210]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[56210]: osdmap e53: 8 total, 8 up, 8 in 2026-03-09T18:24:08.099 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:07 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:08.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:07 vm03 ceph-mon[54135]: Saving service alertmanager spec with placement vm02=a;count:1 2026-03-09T18:24:08.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:07 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:08.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:07 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2026-03-09T18:24:08.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:07 vm03 ceph-mon[54135]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2026-03-09T18:24:08.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:07 vm03 ceph-mon[54135]: osdmap e53: 8 total, 8 up, 8 in 2026-03-09T18:24:08.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:07 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:08.285 INFO:teuthology.orchestra.run.vm02.stdout:[client.0] 2026-03-09T18:24:08.285 INFO:teuthology.orchestra.run.vm02.stdout: key = AQBIEK9pZWWeEBAAQJVXZpQtslSIHl8k6+mbQg== 2026-03-09T18:24:08.459 DEBUG:teuthology.orchestra.run.vm02:> set -ex 2026-03-09T18:24:08.459 DEBUG:teuthology.orchestra.run.vm02:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-03-09T18:24:08.459 DEBUG:teuthology.orchestra.run.vm02:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-03-09T18:24:08.498 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-03-09T18:24:08.675 INFO:teuthology.orchestra.run.vm03.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.b/config 2026-03-09T18:24:08.969 INFO:teuthology.orchestra.run.vm03.stdout:[client.1] 2026-03-09T18:24:08.969 INFO:teuthology.orchestra.run.vm03.stdout: key = AQBIEK9po3pfORAARvYpFCYkPTgS3WeZx8ww6w== 2026-03-09T18:24:09.098 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:08 vm03 ceph-mon[54135]: pgmap v119: 100 pgs: 32 active+clean, 35 creating+peering, 33 unknown; 578 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2026-03-09T18:24:09.098 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:08 vm03 ceph-mon[54135]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;vm03=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:09.098 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:08 vm03 ceph-mon[54135]: Saving service grafana spec with placement vm03=a;count:1 2026-03-09T18:24:09.098 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:08 vm03 ceph-mon[54135]: osdmap e54: 8 total, 8 up, 8 in 2026-03-09T18:24:09.098 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:08 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3713956150' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T18:24:09.098 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:08 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T18:24:09.098 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:08 vm03 ceph-mon[54135]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T18:24:09.098 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:08 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/368115570' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T18:24:09.098 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:08 vm03 ceph-mon[54135]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T18:24:09.098 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:08 vm03 ceph-mon[54135]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T18:24:09.098 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:08 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/3491705898' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T18:24:09.098 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:08 vm03 ceph-mon[54135]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T18:24:09.098 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:08 vm03 ceph-mon[54135]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T18:24:09.125 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T18:24:09.125 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-03-09T18:24:09.125 DEBUG:teuthology.orchestra.run.vm03:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-03-09T18:24:09.160 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-03-09T18:24:09.160 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-03-09T18:24:09.160 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph mgr dump --format=json 2026-03-09T18:24:09.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[50486]: pgmap v119: 100 pgs: 32 active+clean, 35 creating+peering, 33 unknown; 578 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2026-03-09T18:24:09.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[50486]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;vm03=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:09.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[50486]: Saving service grafana spec with placement vm03=a;count:1 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[50486]: osdmap e54: 8 total, 8 up, 8 in 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3713956150' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[50486]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/368115570' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[50486]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[50486]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/3491705898' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[50486]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[50486]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[56210]: pgmap v119: 100 pgs: 32 active+clean, 35 creating+peering, 33 unknown; 578 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[56210]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;vm03=a", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[56210]: Saving service grafana spec with placement vm03=a;count:1 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[56210]: osdmap e54: 8 total, 8 up, 8 in 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3713956150' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[56210]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/368115570' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[56210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[56210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/3491705898' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[56210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-03-09T18:24:09.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:08 vm02 ceph-mon[56210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-03-09T18:24:09.364 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:09.650 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:24:09.831 INFO:teuthology.orchestra.run.vm02.stdout:{"epoch":14,"flags":0,"active_gid":14150,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6800","nonce":1807909863},{"type":"v1","addr":"192.168.123.102:6801","nonce":1807909863}]},"active_addr":"192.168.123.102:6801/1807909863","active_change":"2026-03-09T18:21:46.312743+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14202,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://192.168.123.102:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"192.168.123.102:0","nonce":3005108978}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"192.168.123.102:0","nonce":3203145134}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"192.168.123.102:0","nonce":1704035921}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"192.168.123.102:0","nonce":3587520553}]}]} 2026-03-09T18:24:09.833 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-03-09T18:24:09.833 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-03-09T18:24:09.833 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd dump --format=json 2026-03-09T18:24:10.018 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:10.290 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:24:10.290 INFO:teuthology.orchestra.run.vm02.stdout:{"epoch":56,"fsid":"a3515824-1be4-11f1-b292-f5e4728bca3d","created":"2026-03-09T18:21:21.876887+0000","modified":"2026-03-09T18:24:10.210416+0000","last_up_change":"2026-03-09T18:23:57.068842+0000","last_in_change":"2026-03-09T18:23:44.959340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-09T18:22:56.382179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"datapool","create_time":"2026-03-09T18:24:00.794413+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":".rgw.root","create_time":"2026-03-09T18:24:01.259751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2026-03-09T18:24:03.318190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2026-03-09T18:24:05.227606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2026-03-09T18:24:07.324462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fed479aa-8268-4fe5-8e7c-7c393735e28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6802","nonce":201462935},{"type":"v1","addr":"192.168.123.102:6803","nonce":201462935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6804","nonce":201462935},{"type":"v1","addr":"192.168.123.102:6805","nonce":201462935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6808","nonce":201462935},{"type":"v1","addr":"192.168.123.102:6809","nonce":201462935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6806","nonce":201462935},{"type":"v1","addr":"192.168.123.102:6807","nonce":201462935}]},"public_addr":"192.168.123.102:6803/201462935","cluster_addr":"192.168.123.102:6805/201462935","heartbeat_back_addr":"192.168.123.102:6809/201462935","heartbeat_front_addr":"192.168.123.102:6807/201462935","state":["exists","up"]},{"osd":1,"uuid":"1736e6d8-0962-4235-9bc7-ee9697be5f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6810","nonce":1304575059},{"type":"v1","addr":"192.168.123.102:6811","nonce":1304575059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6812","nonce":1304575059},{"type":"v1","addr":"192.168.123.102:6813","nonce":1304575059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6816","nonce":1304575059},{"type":"v1","addr":"192.168.123.102:6817","nonce":1304575059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6814","nonce":1304575059},{"type":"v1","addr":"192.168.123.102:6815","nonce":1304575059}]},"public_addr":"192.168.123.102:6811/1304575059","cluster_addr":"192.168.123.102:6813/1304575059","heartbeat_back_addr":"192.168.123.102:6817/1304575059","heartbeat_front_addr":"192.168.123.102:6815/1304575059","state":["exists","up"]},{"osd":2,"uuid":"0e2314f8-be12-474e-a11e-3d5d46cc8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6818","nonce":1444582995},{"type":"v1","addr":"192.168.123.102:6819","nonce":1444582995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6820","nonce":1444582995},{"type":"v1","addr":"192.168.123.102:6821","nonce":1444582995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6824","nonce":1444582995},{"type":"v1","addr":"192.168.123.102:6825","nonce":1444582995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6822","nonce":1444582995},{"type":"v1","addr":"192.168.123.102:6823","nonce":1444582995}]},"public_addr":"192.168.123.102:6819/1444582995","cluster_addr":"192.168.123.102:6821/1444582995","heartbeat_back_addr":"192.168.123.102:6825/1444582995","heartbeat_front_addr":"192.168.123.102:6823/1444582995","state":["exists","up"]},{"osd":3,"uuid":"5388e10f-3054-4eea-a54e-1a6b4abe8a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6826","nonce":3447875147},{"type":"v1","addr":"192.168.123.102:6827","nonce":3447875147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6828","nonce":3447875147},{"type":"v1","addr":"192.168.123.102:6829","nonce":3447875147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6832","nonce":3447875147},{"type":"v1","addr":"192.168.123.102:6833","nonce":3447875147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6830","nonce":3447875147},{"type":"v1","addr":"192.168.123.102:6831","nonce":3447875147}]},"public_addr":"192.168.123.102:6827/3447875147","cluster_addr":"192.168.123.102:6829/3447875147","heartbeat_back_addr":"192.168.123.102:6833/3447875147","heartbeat_front_addr":"192.168.123.102:6831/3447875147","state":["exists","up"]},{"osd":4,"uuid":"c4b55510-663a-4d2f-8c08-7f66cc8c0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6800","nonce":4190956836},{"type":"v1","addr":"192.168.123.103:6801","nonce":4190956836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6802","nonce":4190956836},{"type":"v1","addr":"192.168.123.103:6803","nonce":4190956836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6806","nonce":4190956836},{"type":"v1","addr":"192.168.123.103:6807","nonce":4190956836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6804","nonce":4190956836},{"type":"v1","addr":"192.168.123.103:6805","nonce":4190956836}]},"public_addr":"192.168.123.103:6801/4190956836","cluster_addr":"192.168.123.103:6803/4190956836","heartbeat_back_addr":"192.168.123.103:6807/4190956836","heartbeat_front_addr":"192.168.123.103:6805/4190956836","state":["exists","up"]},{"osd":5,"uuid":"8af9ca3d-6e5b-4912-a874-64153fae561a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6808","nonce":3715823931},{"type":"v1","addr":"192.168.123.103:6809","nonce":3715823931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6810","nonce":3715823931},{"type":"v1","addr":"192.168.123.103:6811","nonce":3715823931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6814","nonce":3715823931},{"type":"v1","addr":"192.168.123.103:6815","nonce":3715823931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6812","nonce":3715823931},{"type":"v1","addr":"192.168.123.103:6813","nonce":3715823931}]},"public_addr":"192.168.123.103:6809/3715823931","cluster_addr":"192.168.123.103:6811/3715823931","heartbeat_back_addr":"192.168.123.103:6815/3715823931","heartbeat_front_addr":"192.168.123.103:6813/3715823931","state":["exists","up"]},{"osd":6,"uuid":"84e5e6e3-e6be-4236-9747-322cb8ca6dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6816","nonce":734423527},{"type":"v1","addr":"192.168.123.103:6817","nonce":734423527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6818","nonce":734423527},{"type":"v1","addr":"192.168.123.103:6819","nonce":734423527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6822","nonce":734423527},{"type":"v1","addr":"192.168.123.103:6823","nonce":734423527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6820","nonce":734423527},{"type":"v1","addr":"192.168.123.103:6821","nonce":734423527}]},"public_addr":"192.168.123.103:6817/734423527","cluster_addr":"192.168.123.103:6819/734423527","heartbeat_back_addr":"192.168.123.103:6823/734423527","heartbeat_front_addr":"192.168.123.103:6821/734423527","state":["exists","up"]},{"osd":7,"uuid":"6c2a6ef2-5b1d-4dc5-986f-b8a8d26365dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6824","nonce":2163349677},{"type":"v1","addr":"192.168.123.103:6825","nonce":2163349677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6826","nonce":2163349677},{"type":"v1","addr":"192.168.123.103:6827","nonce":2163349677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6830","nonce":2163349677},{"type":"v1","addr":"192.168.123.103:6831","nonce":2163349677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6828","nonce":2163349677},{"type":"v1","addr":"192.168.123.103:6829","nonce":2163349677}]},"public_addr":"192.168.123.103:6825/2163349677","cluster_addr":"192.168.123.103:6827/2163349677","heartbeat_back_addr":"192.168.123.103:6831/2163349677","heartbeat_front_addr":"192.168.123.103:6829/2163349677","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:22:26.795858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:22:39.381354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:22:52.805980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:04.905995+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:16.913642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:30.133397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:42.759151+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:54.878585+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.123.102:6800/2636160183":"2026-03-10T18:21:46.312647+0000","192.168.123.102:0/2773773004":"2026-03-10T18:21:46.312647+0000","192.168.123.102:0/759769202":"2026-03-10T18:21:46.312647+0000","192.168.123.102:0/3939506746":"2026-03-10T18:21:46.312647+0000","192.168.123.102:6801/2636160183":"2026-03-10T18:21:46.312647+0000","192.168.123.102:0/1875777209":"2026-03-10T18:21:34.217391+0000","192.168.123.102:0/2162226603":"2026-03-10T18:21:34.217391+0000","192.168.123.102:0/932629632":"2026-03-10T18:21:34.217391+0000","192.168.123.102:6801/51601173":"2026-03-10T18:21:34.217391+0000","192.168.123.102:6800/51601173":"2026-03-10T18:21:34.217391+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[50486]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[50486]: osdmap e55: 8 total, 8 up, 8 in 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3713956150' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[50486]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[50486]: pgmap v122: 132 pgs: 65 active+clean, 23 creating+peering, 44 unknown; 578 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/6632537' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[56210]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[56210]: osdmap e55: 8 total, 8 up, 8 in 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3713956150' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[56210]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[56210]: pgmap v122: 132 pgs: 65 active+clean, 23 creating+peering, 44 unknown; 578 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2026-03-09T18:24:10.305 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:10 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/6632537' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-03-09T18:24:10.451 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-03-09T18:24:10.451 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd dump --format=json 2026-03-09T18:24:10.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:10 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2026-03-09T18:24:10.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:10 vm03 ceph-mon[54135]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2026-03-09T18:24:10.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:10 vm03 ceph-mon[54135]: osdmap e55: 8 total, 8 up, 8 in 2026-03-09T18:24:10.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:10 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T18:24:10.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:10 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3713956150' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T18:24:10.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:10 vm03 ceph-mon[54135]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2026-03-09T18:24:10.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:10 vm03 ceph-mon[54135]: pgmap v122: 132 pgs: 65 active+clean, 23 creating+peering, 44 unknown; 578 KiB data, 215 MiB used, 160 GiB / 160 GiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2026-03-09T18:24:10.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:10 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/6632537' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-03-09T18:24:10.608 INFO:journalctl@ceph.rgw.foo.a.vm02.stdout:Mar 09 18:24:10 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-rgw-foo-a[74262]: 2026-03-09T18:24:10.351+0000 7f2d0ad62980 -1 LDAP not started since no server URIs were provided in the configuration. 2026-03-09T18:24:10.709 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:11.054 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:24:11.055 INFO:teuthology.orchestra.run.vm02.stdout:{"epoch":56,"fsid":"a3515824-1be4-11f1-b292-f5e4728bca3d","created":"2026-03-09T18:21:21.876887+0000","modified":"2026-03-09T18:24:10.210416+0000","last_up_change":"2026-03-09T18:23:57.068842+0000","last_in_change":"2026-03-09T18:23:44.959340+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-03-09T18:22:56.382179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"datapool","create_time":"2026-03-09T18:24:00.794413+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":".rgw.root","create_time":"2026-03-09T18:24:01.259751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2026-03-09T18:24:03.318190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2026-03-09T18:24:05.227606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2026-03-09T18:24:07.324462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fed479aa-8268-4fe5-8e7c-7c393735e28c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6802","nonce":201462935},{"type":"v1","addr":"192.168.123.102:6803","nonce":201462935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6804","nonce":201462935},{"type":"v1","addr":"192.168.123.102:6805","nonce":201462935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6808","nonce":201462935},{"type":"v1","addr":"192.168.123.102:6809","nonce":201462935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6806","nonce":201462935},{"type":"v1","addr":"192.168.123.102:6807","nonce":201462935}]},"public_addr":"192.168.123.102:6803/201462935","cluster_addr":"192.168.123.102:6805/201462935","heartbeat_back_addr":"192.168.123.102:6809/201462935","heartbeat_front_addr":"192.168.123.102:6807/201462935","state":["exists","up"]},{"osd":1,"uuid":"1736e6d8-0962-4235-9bc7-ee9697be5f2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6810","nonce":1304575059},{"type":"v1","addr":"192.168.123.102:6811","nonce":1304575059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6812","nonce":1304575059},{"type":"v1","addr":"192.168.123.102:6813","nonce":1304575059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6816","nonce":1304575059},{"type":"v1","addr":"192.168.123.102:6817","nonce":1304575059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6814","nonce":1304575059},{"type":"v1","addr":"192.168.123.102:6815","nonce":1304575059}]},"public_addr":"192.168.123.102:6811/1304575059","cluster_addr":"192.168.123.102:6813/1304575059","heartbeat_back_addr":"192.168.123.102:6817/1304575059","heartbeat_front_addr":"192.168.123.102:6815/1304575059","state":["exists","up"]},{"osd":2,"uuid":"0e2314f8-be12-474e-a11e-3d5d46cc8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6818","nonce":1444582995},{"type":"v1","addr":"192.168.123.102:6819","nonce":1444582995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6820","nonce":1444582995},{"type":"v1","addr":"192.168.123.102:6821","nonce":1444582995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6824","nonce":1444582995},{"type":"v1","addr":"192.168.123.102:6825","nonce":1444582995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6822","nonce":1444582995},{"type":"v1","addr":"192.168.123.102:6823","nonce":1444582995}]},"public_addr":"192.168.123.102:6819/1444582995","cluster_addr":"192.168.123.102:6821/1444582995","heartbeat_back_addr":"192.168.123.102:6825/1444582995","heartbeat_front_addr":"192.168.123.102:6823/1444582995","state":["exists","up"]},{"osd":3,"uuid":"5388e10f-3054-4eea-a54e-1a6b4abe8a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6826","nonce":3447875147},{"type":"v1","addr":"192.168.123.102:6827","nonce":3447875147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6828","nonce":3447875147},{"type":"v1","addr":"192.168.123.102:6829","nonce":3447875147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6832","nonce":3447875147},{"type":"v1","addr":"192.168.123.102:6833","nonce":3447875147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.102:6830","nonce":3447875147},{"type":"v1","addr":"192.168.123.102:6831","nonce":3447875147}]},"public_addr":"192.168.123.102:6827/3447875147","cluster_addr":"192.168.123.102:6829/3447875147","heartbeat_back_addr":"192.168.123.102:6833/3447875147","heartbeat_front_addr":"192.168.123.102:6831/3447875147","state":["exists","up"]},{"osd":4,"uuid":"c4b55510-663a-4d2f-8c08-7f66cc8c0a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6800","nonce":4190956836},{"type":"v1","addr":"192.168.123.103:6801","nonce":4190956836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6802","nonce":4190956836},{"type":"v1","addr":"192.168.123.103:6803","nonce":4190956836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6806","nonce":4190956836},{"type":"v1","addr":"192.168.123.103:6807","nonce":4190956836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6804","nonce":4190956836},{"type":"v1","addr":"192.168.123.103:6805","nonce":4190956836}]},"public_addr":"192.168.123.103:6801/4190956836","cluster_addr":"192.168.123.103:6803/4190956836","heartbeat_back_addr":"192.168.123.103:6807/4190956836","heartbeat_front_addr":"192.168.123.103:6805/4190956836","state":["exists","up"]},{"osd":5,"uuid":"8af9ca3d-6e5b-4912-a874-64153fae561a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6808","nonce":3715823931},{"type":"v1","addr":"192.168.123.103:6809","nonce":3715823931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6810","nonce":3715823931},{"type":"v1","addr":"192.168.123.103:6811","nonce":3715823931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6814","nonce":3715823931},{"type":"v1","addr":"192.168.123.103:6815","nonce":3715823931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6812","nonce":3715823931},{"type":"v1","addr":"192.168.123.103:6813","nonce":3715823931}]},"public_addr":"192.168.123.103:6809/3715823931","cluster_addr":"192.168.123.103:6811/3715823931","heartbeat_back_addr":"192.168.123.103:6815/3715823931","heartbeat_front_addr":"192.168.123.103:6813/3715823931","state":["exists","up"]},{"osd":6,"uuid":"84e5e6e3-e6be-4236-9747-322cb8ca6dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6816","nonce":734423527},{"type":"v1","addr":"192.168.123.103:6817","nonce":734423527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6818","nonce":734423527},{"type":"v1","addr":"192.168.123.103:6819","nonce":734423527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6822","nonce":734423527},{"type":"v1","addr":"192.168.123.103:6823","nonce":734423527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6820","nonce":734423527},{"type":"v1","addr":"192.168.123.103:6821","nonce":734423527}]},"public_addr":"192.168.123.103:6817/734423527","cluster_addr":"192.168.123.103:6819/734423527","heartbeat_back_addr":"192.168.123.103:6823/734423527","heartbeat_front_addr":"192.168.123.103:6821/734423527","state":["exists","up"]},{"osd":7,"uuid":"6c2a6ef2-5b1d-4dc5-986f-b8a8d26365dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6824","nonce":2163349677},{"type":"v1","addr":"192.168.123.103:6825","nonce":2163349677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6826","nonce":2163349677},{"type":"v1","addr":"192.168.123.103:6827","nonce":2163349677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6830","nonce":2163349677},{"type":"v1","addr":"192.168.123.103:6831","nonce":2163349677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"192.168.123.103:6828","nonce":2163349677},{"type":"v1","addr":"192.168.123.103:6829","nonce":2163349677}]},"public_addr":"192.168.123.103:6825/2163349677","cluster_addr":"192.168.123.103:6827/2163349677","heartbeat_back_addr":"192.168.123.103:6831/2163349677","heartbeat_front_addr":"192.168.123.103:6829/2163349677","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:22:26.795858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:22:39.381354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:22:52.805980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:04.905995+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:16.913642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:30.133397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:42.759151+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-03-09T18:23:54.878585+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.123.102:6800/2636160183":"2026-03-10T18:21:46.312647+0000","192.168.123.102:0/2773773004":"2026-03-10T18:21:46.312647+0000","192.168.123.102:0/759769202":"2026-03-10T18:21:46.312647+0000","192.168.123.102:0/3939506746":"2026-03-10T18:21:46.312647+0000","192.168.123.102:6801/2636160183":"2026-03-10T18:21:46.312647+0000","192.168.123.102:0/1875777209":"2026-03-10T18:21:34.217391+0000","192.168.123.102:0/2162226603":"2026-03-10T18:21:34.217391+0000","192.168.123.102:0/932629632":"2026-03-10T18:21:34.217391+0000","192.168.123.102:6801/51601173":"2026-03-10T18:21:34.217391+0000","192.168.123.102:6800/51601173":"2026-03-10T18:21:34.217391+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-03-09T18:24:11.246 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph tell osd.0 flush_pg_stats 2026-03-09T18:24:11.247 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph tell osd.1 flush_pg_stats 2026-03-09T18:24:11.247 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph tell osd.2 flush_pg_stats 2026-03-09T18:24:11.247 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph tell osd.3 flush_pg_stats 2026-03-09T18:24:11.247 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph tell osd.4 flush_pg_stats 2026-03-09T18:24:11.247 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph tell osd.5 flush_pg_stats 2026-03-09T18:24:11.247 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph tell osd.6 flush_pg_stats 2026-03-09T18:24:11.247 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph tell osd.7 flush_pg_stats 2026-03-09T18:24:11.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2026-03-09T18:24:11.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[50486]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2026-03-09T18:24:11.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[50486]: osdmap e56: 8 total, 8 up, 8 in 2026-03-09T18:24:11.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3938158274' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T18:24:11.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:11.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:11.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:11.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2026-03-09T18:24:11.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2026-03-09T18:24:11.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:11.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[50486]: Deploying daemon iscsi.iscsi.a on vm03 2026-03-09T18:24:11.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/5889395' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T18:24:11.313 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2026-03-09T18:24:11.313 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[56210]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2026-03-09T18:24:11.313 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[56210]: osdmap e56: 8 total, 8 up, 8 in 2026-03-09T18:24:11.313 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3938158274' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T18:24:11.313 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:11.313 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:11.313 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:11.313 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2026-03-09T18:24:11.313 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2026-03-09T18:24:11.313 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:11.313 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[56210]: Deploying daemon iscsi.iscsi.a on vm03 2026-03-09T18:24:11.313 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:11 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/5889395' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T18:24:11.323 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:11 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3496793594' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2026-03-09T18:24:11.323 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:11 vm03 ceph-mon[54135]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2026-03-09T18:24:11.323 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:11 vm03 ceph-mon[54135]: osdmap e56: 8 total, 8 up, 8 in 2026-03-09T18:24:11.323 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:11 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3938158274' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T18:24:11.323 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:11 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:11.323 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:11 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:11.323 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:11 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:11.323 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:11 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2026-03-09T18:24:11.323 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:11 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2026-03-09T18:24:11.323 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:11 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:11.323 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:11 vm03 ceph-mon[54135]: Deploying daemon iscsi.iscsi.a on vm03 2026-03-09T18:24:11.323 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:11 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/5889395' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-03-09T18:24:11.945 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:11 vm03 podman[73594]: 2026-03-09 18:24:11.793501464 +0000 UTC m=+0.011998351 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T18:24:12.061 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:12.127 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:12.170 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:12.213 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:12.227 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:12.231 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:12.253 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:11 vm03 podman[73594]: 2026-03-09 18:24:11.947381893 +0000 UTC m=+0.165878780 container init bdef783e9e4bf8bd3139c7804975fd46aa6555cebbcabaa3a832b5ea73b3d82b (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, CEPH_REF=squid, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-03-09T18:24:12.253 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:11 vm03 podman[73594]: 2026-03-09 18:24:11.951529136 +0000 UTC m=+0.170026023 container start bdef783e9e4bf8bd3139c7804975fd46aa6555cebbcabaa3a832b5ea73b3d82b (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a, org.label-schema.license=GPLv2, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0) 2026-03-09T18:24:12.253 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:11 vm03 bash[73594]: bdef783e9e4bf8bd3139c7804975fd46aa6555cebbcabaa3a832b5ea73b3d82b 2026-03-09T18:24:12.253 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:11 vm03 systemd[1]: Started Ceph iscsi.iscsi.a for a3515824-1be4-11f1-b292-f5e4728bca3d. 2026-03-09T18:24:12.253 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: debug Started the configuration object watcher 2026-03-09T18:24:12.253 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: debug Checking for config object changes every 1s 2026-03-09T18:24:12.253 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: debug Processing osd blocklist entries for this node 2026-03-09T18:24:12.254 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:12.258 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:12.753 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: debug Reading the configuration object to update local LIO configuration 2026-03-09T18:24:12.753 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: debug Configuration does not have an entry for this host(vm03.local) - nothing to define to LIO 2026-03-09T18:24:12.753 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: * Serving Flask app 'rbd-target-api' (lazy loading) 2026-03-09T18:24:12.753 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: * Environment: production 2026-03-09T18:24:12.753 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: WARNING: This is a development server. Do not use it in a production deployment. 2026-03-09T18:24:12.753 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: Use a production WSGI server instead. 2026-03-09T18:24:12.753 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: * Debug mode: off 2026-03-09T18:24:12.753 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: debug * Running on all addresses. 2026-03-09T18:24:12.753 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: WARNING: This is a development server. Do not use it in a production deployment. 2026-03-09T18:24:12.753 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: * Running on all addresses. 2026-03-09T18:24:12.753 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: WARNING: This is a development server. Do not use it in a production deployment. 2026-03-09T18:24:12.753 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: debug * Running on http://[::1]:5000/ (Press CTRL+C to quit) 2026-03-09T18:24:12.753 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: * Running on http://[::1]:5000/ (Press CTRL+C to quit) 2026-03-09T18:24:13.127 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:12 vm02 ceph-mon[50486]: pgmap v124: 132 pgs: 103 active+clean, 9 creating+peering, 20 unknown; 578 KiB data, 216 MiB used, 160 GiB / 160 GiB avail; 5.3 KiB/s rd, 978 B/s wr, 11 op/s 2026-03-09T18:24:13.128 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:12 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:13.128 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:12 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:13.128 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:12 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:13.128 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:12 vm02 ceph-mon[50486]: Checking pool "datapool" exists for service iscsi.datapool 2026-03-09T18:24:13.128 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:12 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:13.128 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:12 vm02 ceph-mon[50486]: from='client.? 192.168.123.103:0/2836426015' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-03-09T18:24:13.128 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:12 vm02 ceph-mon[56210]: pgmap v124: 132 pgs: 103 active+clean, 9 creating+peering, 20 unknown; 578 KiB data, 216 MiB used, 160 GiB / 160 GiB avail; 5.3 KiB/s rd, 978 B/s wr, 11 op/s 2026-03-09T18:24:13.128 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:12 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:13.128 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:12 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:13.128 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:12 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:13.128 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:12 vm02 ceph-mon[56210]: Checking pool "datapool" exists for service iscsi.datapool 2026-03-09T18:24:13.128 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:12 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:13.128 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:12 vm02 ceph-mon[56210]: from='client.? 192.168.123.103:0/2836426015' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-03-09T18:24:13.221 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:12 vm03 ceph-mon[54135]: pgmap v124: 132 pgs: 103 active+clean, 9 creating+peering, 20 unknown; 578 KiB data, 216 MiB used, 160 GiB / 160 GiB avail; 5.3 KiB/s rd, 978 B/s wr, 11 op/s 2026-03-09T18:24:13.221 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:12 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:13.221 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:12 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:13.221 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:12 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:13.221 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:12 vm03 ceph-mon[54135]: Checking pool "datapool" exists for service iscsi.datapool 2026-03-09T18:24:13.221 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:12 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:13.221 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:12 vm03 ceph-mon[54135]: from='client.? 192.168.123.103:0/2836426015' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-03-09T18:24:13.364 INFO:teuthology.orchestra.run.vm02.stdout:163208757255 2026-03-09T18:24:13.364 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd last-stat-seq osd.6 2026-03-09T18:24:13.478 INFO:teuthology.orchestra.run.vm02.stdout:51539607572 2026-03-09T18:24:13.478 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd last-stat-seq osd.1 2026-03-09T18:24:13.519 INFO:teuthology.orchestra.run.vm02.stdout:68719476753 2026-03-09T18:24:13.519 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd last-stat-seq osd.2 2026-03-09T18:24:13.552 INFO:teuthology.orchestra.run.vm02.stdout:141733920778 2026-03-09T18:24:13.552 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd last-stat-seq osd.5 2026-03-09T18:24:13.563 INFO:teuthology.orchestra.run.vm02.stdout:120259084300 2026-03-09T18:24:13.563 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd last-stat-seq osd.4 2026-03-09T18:24:13.569 INFO:teuthology.orchestra.run.vm02.stdout:34359738390 2026-03-09T18:24:13.569 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd last-stat-seq osd.0 2026-03-09T18:24:13.625 INFO:teuthology.orchestra.run.vm02.stdout:188978561029 2026-03-09T18:24:13.625 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd last-stat-seq osd.7 2026-03-09T18:24:13.682 INFO:teuthology.orchestra.run.vm02.stdout:98784247823 2026-03-09T18:24:13.682 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph osd last-stat-seq osd.3 2026-03-09T18:24:13.981 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:14.000 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:13 vm02 ceph-mon[56210]: Deploying daemon prometheus.a on vm03 2026-03-09T18:24:14.000 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:13 vm02 ceph-mon[56210]: mgrmap e15: y(active, since 2m), standbys: x 2026-03-09T18:24:14.000 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:13 vm02 ceph-mon[56210]: osdmap e57: 8 total, 8 up, 8 in 2026-03-09T18:24:14.000 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:14.000 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:14.000 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:13 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:14.000 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:13 vm02 ceph-mon[50486]: Deploying daemon prometheus.a on vm03 2026-03-09T18:24:14.000 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:13 vm02 ceph-mon[50486]: mgrmap e15: y(active, since 2m), standbys: x 2026-03-09T18:24:14.001 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:13 vm02 ceph-mon[50486]: osdmap e57: 8 total, 8 up, 8 in 2026-03-09T18:24:14.001 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:14.001 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:14.001 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:13 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:14.253 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:13 vm03 ceph-mon[54135]: Deploying daemon prometheus.a on vm03 2026-03-09T18:24:14.254 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:13 vm03 ceph-mon[54135]: mgrmap e15: y(active, since 2m), standbys: x 2026-03-09T18:24:14.254 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:13 vm03 ceph-mon[54135]: osdmap e57: 8 total, 8 up, 8 in 2026-03-09T18:24:14.254 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:14.254 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:14.254 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:13 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:14.449 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:14.455 INFO:teuthology.orchestra.run.vm02.stdout:163208757255 2026-03-09T18:24:14.643 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:14.644 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:14.854 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757255 got 163208757255 for osd.6 2026-03-09T18:24:14.854 DEBUG:teuthology.parallel:result is None 2026-03-09T18:24:14.902 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:14.902 INFO:teuthology.orchestra.run.vm02.stdout:141733920778 2026-03-09T18:24:14.916 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:15.106 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:15.114 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:15.150 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:14 vm02 ceph-mon[50486]: pgmap v125: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail; 79 KiB/s rd, 6.5 KiB/s wr, 191 op/s 2026-03-09T18:24:15.150 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:14 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/310641882' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-03-09T18:24:15.150 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:14 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:15.150 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:15 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/463548917' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-03-09T18:24:15.150 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:15 vm02 ceph-mon[56210]: pgmap v125: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail; 79 KiB/s rd, 6.5 KiB/s wr, 191 op/s 2026-03-09T18:24:15.151 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:15 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/310641882' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-03-09T18:24:15.151 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:15 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:15.151 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:15 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/463548917' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-03-09T18:24:15.179 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920778 got 141733920778 for osd.5 2026-03-09T18:24:15.179 DEBUG:teuthology.parallel:result is None 2026-03-09T18:24:15.254 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:15 vm03 ceph-mon[54135]: pgmap v125: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail; 79 KiB/s rd, 6.5 KiB/s wr, 191 op/s 2026-03-09T18:24:15.254 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:15 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/310641882' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-03-09T18:24:15.254 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:15 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:15.254 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:15 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/463548917' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-03-09T18:24:15.419 INFO:teuthology.orchestra.run.vm02.stdout:51539607572 2026-03-09T18:24:15.598 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607572 got 51539607572 for osd.1 2026-03-09T18:24:15.598 DEBUG:teuthology.parallel:result is None 2026-03-09T18:24:15.619 INFO:teuthology.orchestra.run.vm02.stdout:68719476753 2026-03-09T18:24:15.660 INFO:teuthology.orchestra.run.vm02.stdout:120259084300 2026-03-09T18:24:15.748 INFO:teuthology.orchestra.run.vm02.stdout:98784247823 2026-03-09T18:24:15.829 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476753 got 68719476753 for osd.2 2026-03-09T18:24:15.829 DEBUG:teuthology.parallel:result is None 2026-03-09T18:24:15.842 INFO:teuthology.orchestra.run.vm02.stdout:34359738390 2026-03-09T18:24:15.867 INFO:teuthology.orchestra.run.vm02.stdout:188978561029 2026-03-09T18:24:15.972 INFO:tasks.cephadm.ceph_manager.ceph:need seq 120259084300 got 120259084300 for osd.4 2026-03-09T18:24:15.972 DEBUG:teuthology.parallel:result is None 2026-03-09T18:24:15.985 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247823 got 98784247823 for osd.3 2026-03-09T18:24:15.985 DEBUG:teuthology.parallel:result is None 2026-03-09T18:24:16.012 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738390 got 34359738390 for osd.0 2026-03-09T18:24:16.012 DEBUG:teuthology.parallel:result is None 2026-03-09T18:24:16.098 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561029 got 188978561029 for osd.7 2026-03-09T18:24:16.098 DEBUG:teuthology.parallel:result is None 2026-03-09T18:24:16.098 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-03-09T18:24:16.098 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph pg dump --format=json 2026-03-09T18:24:16.292 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:16.321 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:16 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/298641503' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-03-09T18:24:16.321 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:16 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1401913905' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-03-09T18:24:16.321 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:16 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3303609606' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-03-09T18:24:16.321 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:16 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/4110164368' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-03-09T18:24:16.321 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:16 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/3472003557' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-03-09T18:24:16.321 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:16 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1178758739' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-03-09T18:24:16.321 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:16 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/298641503' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-03-09T18:24:16.321 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:16 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1401913905' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-03-09T18:24:16.321 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:16 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3303609606' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-03-09T18:24:16.321 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:16 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/4110164368' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-03-09T18:24:16.321 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:16 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/3472003557' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-03-09T18:24:16.321 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:16 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1178758739' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-03-09T18:24:16.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:16 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/298641503' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-03-09T18:24:16.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:16 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1401913905' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-03-09T18:24:16.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:16 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3303609606' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-03-09T18:24:16.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:16 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/4110164368' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-03-09T18:24:16.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:16 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/3472003557' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-03-09T18:24:16.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:16 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1178758739' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-03-09T18:24:16.574 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:24:16.576 INFO:teuthology.orchestra.run.vm02.stderr:dumped all 2026-03-09T18:24:16.739 INFO:teuthology.orchestra.run.vm02.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2026-03-09T18:24:15.387243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596507,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":805,"num_read_kb":545,"num_write":559,"num_write_kb":2195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":565,"ondisk_log_size":565,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":389,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":167739392,"kb_used":221400,"kb_used_data":6708,"kb_used_omap":12,"kb_used_meta":214515,"kb_avail":167517992,"statfs":{"total":171765137408,"available":171538423808,"internally_reserved":0,"allocated":6868992,"data_stored":3834289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12710,"internal_metadata":219663962},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4353,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":708,"num_read_kb":464,"num_write":423,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.176668"},"pg_stats":[{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670904+0000","last_change":"2026-03-09T18:24:03.214654+0000","last_active":"2026-03-09T18:24:13.670904+0000","last_peered":"2026-03-09T18:24:13.670904+0000","last_clean":"2026-03-09T18:24:13.670904+0000","last_became_active":"2026-03-09T18:24:03.213803+0000","last_became_peered":"2026-03-09T18:24:03.213803+0000","last_unstale":"2026-03-09T18:24:13.670904+0000","last_undegraded":"2026-03-09T18:24:13.670904+0000","last_fullsized":"2026-03-09T18:24:13.670904+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:46:08.381053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"56'9","reported_seq":39,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.606426+0000","last_change":"2026-03-09T18:24:05.205753+0000","last_active":"2026-03-09T18:24:13.606426+0000","last_peered":"2026-03-09T18:24:13.606426+0000","last_clean":"2026-03-09T18:24:13.606426+0000","last_became_active":"2026-03-09T18:24:05.204876+0000","last_became_peered":"2026-03-09T18:24:05.204876+0000","last_unstale":"2026-03-09T18:24:13.606426+0000","last_undegraded":"2026-03-09T18:24:13.606426+0000","last_fullsized":"2026-03-09T18:24:13.606426+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:27:26.568932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.240437+0000","last_change":"2026-03-09T18:24:07.231940+0000","last_active":"2026-03-09T18:24:10.240437+0000","last_peered":"2026-03-09T18:24:10.240437+0000","last_clean":"2026-03-09T18:24:10.240437+0000","last_became_active":"2026-03-09T18:24:07.231783+0000","last_became_peered":"2026-03-09T18:24:07.231783+0000","last_unstale":"2026-03-09T18:24:10.240437+0000","last_undegraded":"2026-03-09T18:24:10.240437+0000","last_fullsized":"2026-03-09T18:24:10.240437+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:47:20.940484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.606398+0000","last_change":"2026-03-09T18:24:09.226383+0000","last_active":"2026-03-09T18:24:13.606398+0000","last_peered":"2026-03-09T18:24:13.606398+0000","last_clean":"2026-03-09T18:24:13.606398+0000","last_became_active":"2026-03-09T18:24:09.226245+0000","last_became_peered":"2026-03-09T18:24:09.226245+0000","last_unstale":"2026-03-09T18:24:13.606398+0000","last_undegraded":"2026-03-09T18:24:13.606398+0000","last_fullsized":"2026-03-09T18:24:13.606398+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:29:54.921532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223160+0000","last_change":"2026-03-09T18:24:09.557919+0000","last_active":"2026-03-09T18:24:10.223160+0000","last_peered":"2026-03-09T18:24:10.223160+0000","last_clean":"2026-03-09T18:24:10.223160+0000","last_became_active":"2026-03-09T18:24:09.557775+0000","last_became_peered":"2026-03-09T18:24:09.557775+0000","last_unstale":"2026-03-09T18:24:10.223160+0000","last_undegraded":"2026-03-09T18:24:10.223160+0000","last_fullsized":"2026-03-09T18:24:10.223160+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:30:19.527333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223172+0000","last_change":"2026-03-09T18:24:03.200786+0000","last_active":"2026-03-09T18:24:10.223172+0000","last_peered":"2026-03-09T18:24:10.223172+0000","last_clean":"2026-03-09T18:24:10.223172+0000","last_became_active":"2026-03-09T18:24:03.191302+0000","last_became_peered":"2026-03-09T18:24:03.191302+0000","last_unstale":"2026-03-09T18:24:10.223172+0000","last_undegraded":"2026-03-09T18:24:10.223172+0000","last_fullsized":"2026-03-09T18:24:10.223172+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:43:21.407361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"56'15","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:11.057678+0000","last_change":"2026-03-09T18:24:05.206039+0000","last_active":"2026-03-09T18:24:11.057678+0000","last_peered":"2026-03-09T18:24:11.057678+0000","last_clean":"2026-03-09T18:24:11.057678+0000","last_became_active":"2026-03-09T18:24:05.205472+0000","last_became_peered":"2026-03-09T18:24:05.205472+0000","last_unstale":"2026-03-09T18:24:11.057678+0000","last_undegraded":"2026-03-09T18:24:11.057678+0000","last_fullsized":"2026-03-09T18:24:11.057678+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:54:08.599023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605464+0000","last_change":"2026-03-09T18:24:07.231661+0000","last_active":"2026-03-09T18:24:13.605464+0000","last_peered":"2026-03-09T18:24:13.605464+0000","last_clean":"2026-03-09T18:24:13.605464+0000","last_became_active":"2026-03-09T18:24:07.231392+0000","last_became_peered":"2026-03-09T18:24:07.231392+0000","last_unstale":"2026-03-09T18:24:13.605464+0000","last_undegraded":"2026-03-09T18:24:13.605464+0000","last_fullsized":"2026-03-09T18:24:13.605464+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:24:18.946745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256529+0000","last_change":"2026-03-09T18:24:03.186217+0000","last_active":"2026-03-09T18:24:10.256529+0000","last_peered":"2026-03-09T18:24:10.256529+0000","last_clean":"2026-03-09T18:24:10.256529+0000","last_became_active":"2026-03-09T18:24:03.186022+0000","last_became_peered":"2026-03-09T18:24:03.186022+0000","last_unstale":"2026-03-09T18:24:10.256529+0000","last_undegraded":"2026-03-09T18:24:10.256529+0000","last_fullsized":"2026-03-09T18:24:10.256529+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T02:19:24.282682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"56'9","reported_seq":39,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605751+0000","last_change":"2026-03-09T18:24:05.205331+0000","last_active":"2026-03-09T18:24:13.605751+0000","last_peered":"2026-03-09T18:24:13.605751+0000","last_clean":"2026-03-09T18:24:13.605751+0000","last_became_active":"2026-03-09T18:24:05.205038+0000","last_became_peered":"2026-03-09T18:24:05.205038+0000","last_unstale":"2026-03-09T18:24:13.605751+0000","last_undegraded":"2026-03-09T18:24:13.605751+0000","last_fullsized":"2026-03-09T18:24:13.605751+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:20:18.413493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256533+0000","last_change":"2026-03-09T18:24:07.227365+0000","last_active":"2026-03-09T18:24:10.256533+0000","last_peered":"2026-03-09T18:24:10.256533+0000","last_clean":"2026-03-09T18:24:10.256533+0000","last_became_active":"2026-03-09T18:24:07.227279+0000","last_became_peered":"2026-03-09T18:24:07.227279+0000","last_unstale":"2026-03-09T18:24:10.256533+0000","last_undegraded":"2026-03-09T18:24:10.256533+0000","last_fullsized":"2026-03-09T18:24:10.256533+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:45:42.386531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670954+0000","last_change":"2026-03-09T18:24:09.238402+0000","last_active":"2026-03-09T18:24:13.670954+0000","last_peered":"2026-03-09T18:24:13.670954+0000","last_clean":"2026-03-09T18:24:13.670954+0000","last_became_active":"2026-03-09T18:24:09.238326+0000","last_became_peered":"2026-03-09T18:24:09.238326+0000","last_unstale":"2026-03-09T18:24:13.670954+0000","last_undegraded":"2026-03-09T18:24:13.670954+0000","last_fullsized":"2026-03-09T18:24:13.670954+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:47:08.030123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256553+0000","last_change":"2026-03-09T18:24:03.189168+0000","last_active":"2026-03-09T18:24:10.256553+0000","last_peered":"2026-03-09T18:24:10.256553+0000","last_clean":"2026-03-09T18:24:10.256553+0000","last_became_active":"2026-03-09T18:24:03.189036+0000","last_became_peered":"2026-03-09T18:24:03.189036+0000","last_unstale":"2026-03-09T18:24:10.256553+0000","last_undegraded":"2026-03-09T18:24:10.256553+0000","last_fullsized":"2026-03-09T18:24:10.256553+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:16:41.492218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"56'5","reported_seq":33,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605850+0000","last_change":"2026-03-09T18:24:05.199531+0000","last_active":"2026-03-09T18:24:13.605850+0000","last_peered":"2026-03-09T18:24:13.605850+0000","last_clean":"2026-03-09T18:24:13.605850+0000","last_became_active":"2026-03-09T18:24:05.197497+0000","last_became_peered":"2026-03-09T18:24:05.197497+0000","last_unstale":"2026-03-09T18:24:13.605850+0000","last_undegraded":"2026-03-09T18:24:13.605850+0000","last_fullsized":"2026-03-09T18:24:13.605850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:25:35.387567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.246683+0000","last_change":"2026-03-09T18:24:07.225684+0000","last_active":"2026-03-09T18:24:10.246683+0000","last_peered":"2026-03-09T18:24:10.246683+0000","last_clean":"2026-03-09T18:24:10.246683+0000","last_became_active":"2026-03-09T18:24:07.225450+0000","last_became_peered":"2026-03-09T18:24:07.225450+0000","last_unstale":"2026-03-09T18:24:10.246683+0000","last_undegraded":"2026-03-09T18:24:10.246683+0000","last_fullsized":"2026-03-09T18:24:10.246683+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:07:44.609447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256605+0000","last_change":"2026-03-09T18:24:09.237325+0000","last_active":"2026-03-09T18:24:10.256605+0000","last_peered":"2026-03-09T18:24:10.256605+0000","last_clean":"2026-03-09T18:24:10.256605+0000","last_became_active":"2026-03-09T18:24:09.237173+0000","last_became_peered":"2026-03-09T18:24:09.237173+0000","last_unstale":"2026-03-09T18:24:10.256605+0000","last_undegraded":"2026-03-09T18:24:10.256605+0000","last_fullsized":"2026-03-09T18:24:10.256605+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T23:38:21.868434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605955+0000","last_change":"2026-03-09T18:24:09.555175+0000","last_active":"2026-03-09T18:24:13.605955+0000","last_peered":"2026-03-09T18:24:13.605955+0000","last_clean":"2026-03-09T18:24:13.605955+0000","last_became_active":"2026-03-09T18:24:09.555062+0000","last_became_peered":"2026-03-09T18:24:09.555062+0000","last_unstale":"2026-03-09T18:24:13.605955+0000","last_undegraded":"2026-03-09T18:24:13.605955+0000","last_fullsized":"2026-03-09T18:24:13.605955+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T18:55:51.052261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670676+0000","last_change":"2026-03-09T18:24:03.205962+0000","last_active":"2026-03-09T18:24:13.670676+0000","last_peered":"2026-03-09T18:24:13.670676+0000","last_clean":"2026-03-09T18:24:13.670676+0000","last_became_active":"2026-03-09T18:24:03.205812+0000","last_became_peered":"2026-03-09T18:24:03.205812+0000","last_unstale":"2026-03-09T18:24:13.670676+0000","last_undegraded":"2026-03-09T18:24:13.670676+0000","last_fullsized":"2026-03-09T18:24:13.670676+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:43:51.975374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"56'15","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.937471+0000","last_change":"2026-03-09T18:24:05.196657+0000","last_active":"2026-03-09T18:24:10.937471+0000","last_peered":"2026-03-09T18:24:10.937471+0000","last_clean":"2026-03-09T18:24:10.937471+0000","last_became_active":"2026-03-09T18:24:05.196520+0000","last_became_peered":"2026-03-09T18:24:05.196520+0000","last_unstale":"2026-03-09T18:24:10.937471+0000","last_undegraded":"2026-03-09T18:24:10.937471+0000","last_fullsized":"2026-03-09T18:24:10.937471+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T18:39:02.334444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.240324+0000","last_change":"2026-03-09T18:24:07.224678+0000","last_active":"2026-03-09T18:24:10.240324+0000","last_peered":"2026-03-09T18:24:10.240324+0000","last_clean":"2026-03-09T18:24:10.240324+0000","last_became_active":"2026-03-09T18:24:07.224547+0000","last_became_peered":"2026-03-09T18:24:07.224547+0000","last_unstale":"2026-03-09T18:24:10.240324+0000","last_undegraded":"2026-03-09T18:24:10.240324+0000","last_fullsized":"2026-03-09T18:24:10.240324+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:01:37.188001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.231724+0000","last_change":"2026-03-09T18:24:09.558362+0000","last_active":"2026-03-09T18:24:10.231724+0000","last_peered":"2026-03-09T18:24:10.231724+0000","last_clean":"2026-03-09T18:24:10.231724+0000","last_became_active":"2026-03-09T18:24:09.558227+0000","last_became_peered":"2026-03-09T18:24:09.558227+0000","last_unstale":"2026-03-09T18:24:10.231724+0000","last_undegraded":"2026-03-09T18:24:10.231724+0000","last_fullsized":"2026-03-09T18:24:10.231724+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:52:05.264508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605370+0000","last_change":"2026-03-09T18:24:03.190137+0000","last_active":"2026-03-09T18:24:13.605370+0000","last_peered":"2026-03-09T18:24:13.605370+0000","last_clean":"2026-03-09T18:24:13.605370+0000","last_became_active":"2026-03-09T18:24:03.188764+0000","last_became_peered":"2026-03-09T18:24:03.188764+0000","last_unstale":"2026-03-09T18:24:13.605370+0000","last_undegraded":"2026-03-09T18:24:13.605370+0000","last_fullsized":"2026-03-09T18:24:13.605370+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:36:04.720471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"56'12","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:11.062131+0000","last_change":"2026-03-09T18:24:05.220404+0000","last_active":"2026-03-09T18:24:11.062131+0000","last_peered":"2026-03-09T18:24:11.062131+0000","last_clean":"2026-03-09T18:24:11.062131+0000","last_became_active":"2026-03-09T18:24:05.220281+0000","last_became_peered":"2026-03-09T18:24:05.220281+0000","last_unstale":"2026-03-09T18:24:11.062131+0000","last_undegraded":"2026-03-09T18:24:11.062131+0000","last_fullsized":"2026-03-09T18:24:11.062131+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:17:36.536848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605458+0000","last_change":"2026-03-09T18:24:07.230805+0000","last_active":"2026-03-09T18:24:13.605458+0000","last_peered":"2026-03-09T18:24:13.605458+0000","last_clean":"2026-03-09T18:24:13.605458+0000","last_became_active":"2026-03-09T18:24:07.230669+0000","last_became_peered":"2026-03-09T18:24:07.230669+0000","last_unstale":"2026-03-09T18:24:13.605458+0000","last_undegraded":"2026-03-09T18:24:13.605458+0000","last_fullsized":"2026-03-09T18:24:13.605458+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:42:20.095022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.540869+0000","last_change":"2026-03-09T18:24:09.247271+0000","last_active":"2026-03-09T18:24:10.540869+0000","last_peered":"2026-03-09T18:24:10.540869+0000","last_clean":"2026-03-09T18:24:10.540869+0000","last_became_active":"2026-03-09T18:24:09.247083+0000","last_became_peered":"2026-03-09T18:24:09.247083+0000","last_unstale":"2026-03-09T18:24:10.540869+0000","last_undegraded":"2026-03-09T18:24:10.540869+0000","last_fullsized":"2026-03-09T18:24:10.540869+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:59:13.970285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"49'1","reported_seq":26,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.239952+0000","last_change":"2026-03-09T18:24:03.203105+0000","last_active":"2026-03-09T18:24:10.239952+0000","last_peered":"2026-03-09T18:24:10.239952+0000","last_clean":"2026-03-09T18:24:10.239952+0000","last_became_active":"2026-03-09T18:24:03.202671+0000","last_became_peered":"2026-03-09T18:24:03.202671+0000","last_unstale":"2026-03-09T18:24:10.239952+0000","last_undegraded":"2026-03-09T18:24:10.239952+0000","last_fullsized":"2026-03-09T18:24:10.239952+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:22:10.398154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"56'10","reported_seq":38,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671383+0000","last_change":"2026-03-09T18:24:05.699383+0000","last_active":"2026-03-09T18:24:13.671383+0000","last_peered":"2026-03-09T18:24:13.671383+0000","last_clean":"2026-03-09T18:24:13.671383+0000","last_became_active":"2026-03-09T18:24:05.699143+0000","last_became_peered":"2026-03-09T18:24:05.699143+0000","last_unstale":"2026-03-09T18:24:13.671383+0000","last_undegraded":"2026-03-09T18:24:13.671383+0000","last_fullsized":"2026-03-09T18:24:13.671383+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T23:08:07.594817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"56'8","reported_seq":33,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.672925+0000","last_change":"2026-03-09T18:24:07.228890+0000","last_active":"2026-03-09T18:24:13.672925+0000","last_peered":"2026-03-09T18:24:13.672925+0000","last_clean":"2026-03-09T18:24:13.672925+0000","last_became_active":"2026-03-09T18:24:07.228635+0000","last_became_peered":"2026-03-09T18:24:07.228635+0000","last_unstale":"2026-03-09T18:24:13.672925+0000","last_undegraded":"2026-03-09T18:24:13.672925+0000","last_fullsized":"2026-03-09T18:24:13.672925+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:49:37.731144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"56'15","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:11.072998+0000","last_change":"2026-03-09T18:24:05.217400+0000","last_active":"2026-03-09T18:24:11.072998+0000","last_peered":"2026-03-09T18:24:11.072998+0000","last_clean":"2026-03-09T18:24:11.072998+0000","last_became_active":"2026-03-09T18:24:05.214151+0000","last_became_peered":"2026-03-09T18:24:05.214151+0000","last_unstale":"2026-03-09T18:24:11.072998+0000","last_undegraded":"2026-03-09T18:24:11.072998+0000","last_fullsized":"2026-03-09T18:24:11.072998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T02:43:23.643836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222923+0000","last_change":"2026-03-09T18:24:03.206710+0000","last_active":"2026-03-09T18:24:10.222923+0000","last_peered":"2026-03-09T18:24:10.222923+0000","last_clean":"2026-03-09T18:24:10.222923+0000","last_became_active":"2026-03-09T18:24:03.206466+0000","last_became_peered":"2026-03-09T18:24:03.206466+0000","last_unstale":"2026-03-09T18:24:10.222923+0000","last_undegraded":"2026-03-09T18:24:10.222923+0000","last_fullsized":"2026-03-09T18:24:10.222923+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:23:08.492629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"56'8","reported_seq":30,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605292+0000","last_change":"2026-03-09T18:24:07.232460+0000","last_active":"2026-03-09T18:24:13.605292+0000","last_peered":"2026-03-09T18:24:13.605292+0000","last_clean":"2026-03-09T18:24:13.605292+0000","last_became_active":"2026-03-09T18:24:07.232349+0000","last_became_peered":"2026-03-09T18:24:07.232349+0000","last_unstale":"2026-03-09T18:24:13.605292+0000","last_undegraded":"2026-03-09T18:24:13.605292+0000","last_fullsized":"2026-03-09T18:24:13.605292+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:38:06.857831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.257155+0000","last_change":"2026-03-09T18:24:09.230391+0000","last_active":"2026-03-09T18:24:10.257155+0000","last_peered":"2026-03-09T18:24:10.257155+0000","last_clean":"2026-03-09T18:24:10.257155+0000","last_became_active":"2026-03-09T18:24:09.230268+0000","last_became_peered":"2026-03-09T18:24:09.230268+0000","last_unstale":"2026-03-09T18:24:10.257155+0000","last_undegraded":"2026-03-09T18:24:10.257155+0000","last_fullsized":"2026-03-09T18:24:10.257155+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:44:13.269386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"56'18","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.970480+0000","last_change":"2026-03-09T18:24:05.700256+0000","last_active":"2026-03-09T18:24:10.970480+0000","last_peered":"2026-03-09T18:24:10.970480+0000","last_clean":"2026-03-09T18:24:10.970480+0000","last_became_active":"2026-03-09T18:24:05.699919+0000","last_became_peered":"2026-03-09T18:24:05.699919+0000","last_unstale":"2026-03-09T18:24:10.970480+0000","last_undegraded":"2026-03-09T18:24:10.970480+0000","last_fullsized":"2026-03-09T18:24:10.970480+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T02:54:44.851870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223094+0000","last_change":"2026-03-09T18:24:03.206451+0000","last_active":"2026-03-09T18:24:10.223094+0000","last_peered":"2026-03-09T18:24:10.223094+0000","last_clean":"2026-03-09T18:24:10.223094+0000","last_became_active":"2026-03-09T18:24:03.206293+0000","last_became_peered":"2026-03-09T18:24:03.206293+0000","last_unstale":"2026-03-09T18:24:10.223094+0000","last_undegraded":"2026-03-09T18:24:10.223094+0000","last_fullsized":"2026-03-09T18:24:10.223094+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:27:50.135544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605168+0000","last_change":"2026-03-09T18:24:07.245499+0000","last_active":"2026-03-09T18:24:13.605168+0000","last_peered":"2026-03-09T18:24:13.605168+0000","last_clean":"2026-03-09T18:24:13.605168+0000","last_became_active":"2026-03-09T18:24:07.245432+0000","last_became_peered":"2026-03-09T18:24:07.245432+0000","last_unstale":"2026-03-09T18:24:13.605168+0000","last_undegraded":"2026-03-09T18:24:13.605168+0000","last_fullsized":"2026-03-09T18:24:13.605168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:39:31.047599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605148+0000","last_change":"2026-03-09T18:24:09.244563+0000","last_active":"2026-03-09T18:24:13.605148+0000","last_peered":"2026-03-09T18:24:13.605148+0000","last_clean":"2026-03-09T18:24:13.605148+0000","last_became_active":"2026-03-09T18:24:09.244307+0000","last_became_peered":"2026-03-09T18:24:09.244307+0000","last_unstale":"2026-03-09T18:24:13.605148+0000","last_undegraded":"2026-03-09T18:24:13.605148+0000","last_fullsized":"2026-03-09T18:24:13.605148+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:05:39.787781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"56'14","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.606117+0000","last_change":"2026-03-09T18:24:05.205488+0000","last_active":"2026-03-09T18:24:13.606117+0000","last_peered":"2026-03-09T18:24:13.606117+0000","last_clean":"2026-03-09T18:24:13.606117+0000","last_became_active":"2026-03-09T18:24:05.205213+0000","last_became_peered":"2026-03-09T18:24:05.205213+0000","last_unstale":"2026-03-09T18:24:13.606117+0000","last_undegraded":"2026-03-09T18:24:13.606117+0000","last_fullsized":"2026-03-09T18:24:13.606117+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:57:29.994246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"49'1","reported_seq":28,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670789+0000","last_change":"2026-03-09T18:24:03.203567+0000","last_active":"2026-03-09T18:24:13.670789+0000","last_peered":"2026-03-09T18:24:13.670789+0000","last_clean":"2026-03-09T18:24:13.670789+0000","last_became_active":"2026-03-09T18:24:03.203478+0000","last_became_peered":"2026-03-09T18:24:03.203478+0000","last_unstale":"2026-03-09T18:24:13.670789+0000","last_undegraded":"2026-03-09T18:24:13.670789+0000","last_fullsized":"2026-03-09T18:24:13.670789+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:32:33.435841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"56'8","reported_seq":28,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.562838+0000","last_change":"2026-03-09T18:24:07.226716+0000","last_active":"2026-03-09T18:24:10.562838+0000","last_peered":"2026-03-09T18:24:10.562838+0000","last_clean":"2026-03-09T18:24:10.562838+0000","last_became_active":"2026-03-09T18:24:07.226628+0000","last_became_peered":"2026-03-09T18:24:07.226628+0000","last_unstale":"2026-03-09T18:24:10.562838+0000","last_undegraded":"2026-03-09T18:24:10.562838+0000","last_fullsized":"2026-03-09T18:24:10.562838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:27:05.340075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.247639+0000","last_change":"2026-03-09T18:24:09.556811+0000","last_active":"2026-03-09T18:24:10.247639+0000","last_peered":"2026-03-09T18:24:10.247639+0000","last_clean":"2026-03-09T18:24:10.247639+0000","last_became_active":"2026-03-09T18:24:09.556583+0000","last_became_peered":"2026-03-09T18:24:09.556583+0000","last_unstale":"2026-03-09T18:24:10.247639+0000","last_undegraded":"2026-03-09T18:24:10.247639+0000","last_fullsized":"2026-03-09T18:24:10.247639+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:10:00.589800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"56'10","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.993904+0000","last_change":"2026-03-09T18:24:05.221086+0000","last_active":"2026-03-09T18:24:10.993904+0000","last_peered":"2026-03-09T18:24:10.993904+0000","last_clean":"2026-03-09T18:24:10.993904+0000","last_became_active":"2026-03-09T18:24:05.214279+0000","last_became_peered":"2026-03-09T18:24:05.214279+0000","last_unstale":"2026-03-09T18:24:10.993904+0000","last_undegraded":"2026-03-09T18:24:10.993904+0000","last_fullsized":"2026-03-09T18:24:10.993904+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T23:45:00.063968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'1","reported_seq":31,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.378636+0000","last_change":"2026-03-09T18:24:03.187794+0000","last_active":"2026-03-09T18:24:10.378636+0000","last_peered":"2026-03-09T18:24:10.378636+0000","last_clean":"2026-03-09T18:24:10.378636+0000","last_became_active":"2026-03-09T18:24:03.187529+0000","last_became_peered":"2026-03-09T18:24:03.187529+0000","last_unstale":"2026-03-09T18:24:10.378636+0000","last_undegraded":"2026-03-09T18:24:10.378636+0000","last_fullsized":"2026-03-09T18:24:10.378636+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:41:31.116897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"56'8","reported_seq":30,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671438+0000","last_change":"2026-03-09T18:24:07.229911+0000","last_active":"2026-03-09T18:24:13.671438+0000","last_peered":"2026-03-09T18:24:13.671438+0000","last_clean":"2026-03-09T18:24:13.671438+0000","last_became_active":"2026-03-09T18:24:07.229310+0000","last_became_peered":"2026-03-09T18:24:07.229310+0000","last_unstale":"2026-03-09T18:24:13.671438+0000","last_undegraded":"2026-03-09T18:24:13.671438+0000","last_fullsized":"2026-03-09T18:24:13.671438+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:00:26.453487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671411+0000","last_change":"2026-03-09T18:24:09.244395+0000","last_active":"2026-03-09T18:24:13.671411+0000","last_peered":"2026-03-09T18:24:13.671411+0000","last_clean":"2026-03-09T18:24:13.671411+0000","last_became_active":"2026-03-09T18:24:09.243975+0000","last_became_peered":"2026-03-09T18:24:09.243975+0000","last_unstale":"2026-03-09T18:24:13.671411+0000","last_undegraded":"2026-03-09T18:24:13.671411+0000","last_fullsized":"2026-03-09T18:24:13.671411+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:10:24.341136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"56'19","reported_seq":59,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671202+0000","last_change":"2026-03-09T18:24:05.698975+0000","last_active":"2026-03-09T18:24:13.671202+0000","last_peered":"2026-03-09T18:24:13.671202+0000","last_clean":"2026-03-09T18:24:13.671202+0000","last_became_active":"2026-03-09T18:24:05.698745+0000","last_became_peered":"2026-03-09T18:24:05.698745+0000","last_unstale":"2026-03-09T18:24:13.671202+0000","last_undegraded":"2026-03-09T18:24:13.671202+0000","last_fullsized":"2026-03-09T18:24:13.671202+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:04:56.091222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.239681+0000","last_change":"2026-03-09T18:24:03.193347+0000","last_active":"2026-03-09T18:24:10.239681+0000","last_peered":"2026-03-09T18:24:10.239681+0000","last_clean":"2026-03-09T18:24:10.239681+0000","last_became_active":"2026-03-09T18:24:03.193185+0000","last_became_peered":"2026-03-09T18:24:03.193185+0000","last_unstale":"2026-03-09T18:24:10.239681+0000","last_undegraded":"2026-03-09T18:24:10.239681+0000","last_fullsized":"2026-03-09T18:24:10.239681+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:03:47.735359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.672899+0000","last_change":"2026-03-09T18:24:07.229777+0000","last_active":"2026-03-09T18:24:13.672899+0000","last_peered":"2026-03-09T18:24:13.672899+0000","last_clean":"2026-03-09T18:24:13.672899+0000","last_became_active":"2026-03-09T18:24:07.229685+0000","last_became_peered":"2026-03-09T18:24:07.229685+0000","last_unstale":"2026-03-09T18:24:13.672899+0000","last_undegraded":"2026-03-09T18:24:13.672899+0000","last_fullsized":"2026-03-09T18:24:13.672899+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:05:26.703210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.239899+0000","last_change":"2026-03-09T18:24:09.554758+0000","last_active":"2026-03-09T18:24:10.239899+0000","last_peered":"2026-03-09T18:24:10.239899+0000","last_clean":"2026-03-09T18:24:10.239899+0000","last_became_active":"2026-03-09T18:24:09.554597+0000","last_became_peered":"2026-03-09T18:24:09.554597+0000","last_unstale":"2026-03-09T18:24:10.239899+0000","last_undegraded":"2026-03-09T18:24:10.239899+0000","last_fullsized":"2026-03-09T18:24:10.239899+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:56:06.407074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"56'28","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.996563+0000","last_change":"2026-03-09T18:24:05.206932+0000","last_active":"2026-03-09T18:24:10.996563+0000","last_peered":"2026-03-09T18:24:10.996563+0000","last_clean":"2026-03-09T18:24:10.996563+0000","last_became_active":"2026-03-09T18:24:05.206535+0000","last_became_peered":"2026-03-09T18:24:05.206535+0000","last_unstale":"2026-03-09T18:24:10.996563+0000","last_undegraded":"2026-03-09T18:24:10.996563+0000","last_fullsized":"2026-03-09T18:24:10.996563+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:53:31.784253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605606+0000","last_change":"2026-03-09T18:24:03.192541+0000","last_active":"2026-03-09T18:24:13.605606+0000","last_peered":"2026-03-09T18:24:13.605606+0000","last_clean":"2026-03-09T18:24:13.605606+0000","last_became_active":"2026-03-09T18:24:03.192399+0000","last_became_peered":"2026-03-09T18:24:03.192399+0000","last_unstale":"2026-03-09T18:24:13.605606+0000","last_undegraded":"2026-03-09T18:24:13.605606+0000","last_fullsized":"2026-03-09T18:24:13.605606+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:59:06.772662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"50'2","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256814+0000","last_change":"2026-03-09T18:24:04.189493+0000","last_active":"2026-03-09T18:24:10.256814+0000","last_peered":"2026-03-09T18:24:10.256814+0000","last_clean":"2026-03-09T18:24:10.256814+0000","last_became_active":"2026-03-09T18:24:02.183147+0000","last_became_peered":"2026-03-09T18:24:02.183147+0000","last_unstale":"2026-03-09T18:24:10.256814+0000","last_undegraded":"2026-03-09T18:24:10.256814+0000","last_fullsized":"2026-03-09T18:24:10.256814+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:01.152359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:01.152359+0000","last_clean_scrub_stamp":"2026-03-09T18:24:01.152359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T23:11:58.891905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024143390000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.5","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670634+0000","last_change":"2026-03-09T18:24:07.241423+0000","last_active":"2026-03-09T18:24:13.670634+0000","last_peered":"2026-03-09T18:24:13.670634+0000","last_clean":"2026-03-09T18:24:13.670634+0000","last_became_active":"2026-03-09T18:24:07.241237+0000","last_became_peered":"2026-03-09T18:24:07.241237+0000","last_unstale":"2026-03-09T18:24:13.670634+0000","last_undegraded":"2026-03-09T18:24:13.670634+0000","last_fullsized":"2026-03-09T18:24:13.670634+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:01:50.084248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222844+0000","last_change":"2026-03-09T18:24:09.232007+0000","last_active":"2026-03-09T18:24:10.222844+0000","last_peered":"2026-03-09T18:24:10.222844+0000","last_clean":"2026-03-09T18:24:10.222844+0000","last_became_active":"2026-03-09T18:24:09.231372+0000","last_became_peered":"2026-03-09T18:24:09.231372+0000","last_unstale":"2026-03-09T18:24:10.222844+0000","last_undegraded":"2026-03-09T18:24:10.222844+0000","last_fullsized":"2026-03-09T18:24:10.222844+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:35:38.568069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"56'13","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.917888+0000","last_change":"2026-03-09T18:24:05.212698+0000","last_active":"2026-03-09T18:24:10.917888+0000","last_peered":"2026-03-09T18:24:10.917888+0000","last_clean":"2026-03-09T18:24:10.917888+0000","last_became_active":"2026-03-09T18:24:05.209793+0000","last_became_peered":"2026-03-09T18:24:05.209793+0000","last_unstale":"2026-03-09T18:24:10.917888+0000","last_undegraded":"2026-03-09T18:24:10.917888+0000","last_fullsized":"2026-03-09T18:24:10.917888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:19:51.104210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.239712+0000","last_change":"2026-03-09T18:24:03.193297+0000","last_active":"2026-03-09T18:24:10.239712+0000","last_peered":"2026-03-09T18:24:10.239712+0000","last_clean":"2026-03-09T18:24:10.239712+0000","last_became_active":"2026-03-09T18:24:03.193079+0000","last_became_peered":"2026-03-09T18:24:03.193079+0000","last_unstale":"2026-03-09T18:24:10.239712+0000","last_undegraded":"2026-03-09T18:24:10.239712+0000","last_fullsized":"2026-03-09T18:24:10.239712+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:34:47.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"48'1","reported_seq":33,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223891+0000","last_change":"2026-03-09T18:24:04.183349+0000","last_active":"2026-03-09T18:24:10.223891+0000","last_peered":"2026-03-09T18:24:10.223891+0000","last_clean":"2026-03-09T18:24:10.223891+0000","last_became_active":"2026-03-09T18:24:02.183721+0000","last_became_peered":"2026-03-09T18:24:02.183721+0000","last_unstale":"2026-03-09T18:24:10.223891+0000","last_undegraded":"2026-03-09T18:24:10.223891+0000","last_fullsized":"2026-03-09T18:24:10.223891+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:01.152359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:01.152359+0000","last_clean_scrub_stamp":"2026-03-09T18:24:01.152359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:33:46.308541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017623899999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.6","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223951+0000","last_change":"2026-03-09T18:24:07.229394+0000","last_active":"2026-03-09T18:24:10.223951+0000","last_peered":"2026-03-09T18:24:10.223951+0000","last_clean":"2026-03-09T18:24:10.223951+0000","last_became_active":"2026-03-09T18:24:07.227548+0000","last_became_peered":"2026-03-09T18:24:07.227548+0000","last_unstale":"2026-03-09T18:24:10.223951+0000","last_undegraded":"2026-03-09T18:24:10.223951+0000","last_fullsized":"2026-03-09T18:24:10.223951+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:50:47.334701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.246654+0000","last_change":"2026-03-09T18:24:09.557070+0000","last_active":"2026-03-09T18:24:10.246654+0000","last_peered":"2026-03-09T18:24:10.246654+0000","last_clean":"2026-03-09T18:24:10.246654+0000","last_became_active":"2026-03-09T18:24:09.556964+0000","last_became_peered":"2026-03-09T18:24:09.556964+0000","last_unstale":"2026-03-09T18:24:10.246654+0000","last_undegraded":"2026-03-09T18:24:10.246654+0000","last_fullsized":"2026-03-09T18:24:10.246654+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:34:46.948452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"56'12","reported_seq":41,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670877+0000","last_change":"2026-03-09T18:24:05.218664+0000","last_active":"2026-03-09T18:24:13.670877+0000","last_peered":"2026-03-09T18:24:13.670877+0000","last_clean":"2026-03-09T18:24:13.670877+0000","last_became_active":"2026-03-09T18:24:05.218527+0000","last_became_peered":"2026-03-09T18:24:05.218527+0000","last_unstale":"2026-03-09T18:24:13.670877+0000","last_undegraded":"2026-03-09T18:24:13.670877+0000","last_fullsized":"2026-03-09T18:24:13.670877+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T06:15:24.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670851+0000","last_change":"2026-03-09T18:24:03.210263+0000","last_active":"2026-03-09T18:24:13.670851+0000","last_peered":"2026-03-09T18:24:13.670851+0000","last_clean":"2026-03-09T18:24:13.670851+0000","last_became_active":"2026-03-09T18:24:03.210013+0000","last_became_peered":"2026-03-09T18:24:03.210013+0000","last_unstale":"2026-03-09T18:24:13.670851+0000","last_undegraded":"2026-03-09T18:24:13.670851+0000","last_fullsized":"2026-03-09T18:24:13.670851+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:54:25.168399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"56'5","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:12.190315+0000","last_change":"2026-03-09T18:24:04.193958+0000","last_active":"2026-03-09T18:24:12.190315+0000","last_peered":"2026-03-09T18:24:12.190315+0000","last_clean":"2026-03-09T18:24:12.190315+0000","last_became_active":"2026-03-09T18:24:02.190139+0000","last_became_peered":"2026-03-09T18:24:02.190139+0000","last_unstale":"2026-03-09T18:24:12.190315+0000","last_undegraded":"2026-03-09T18:24:12.190315+0000","last_fullsized":"2026-03-09T18:24:12.190315+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:01.152359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:01.152359+0000","last_clean_scrub_stamp":"2026-03-09T18:24:01.152359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:24:46.359307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087120199999999996,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.7","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256632+0000","last_change":"2026-03-09T18:24:07.226949+0000","last_active":"2026-03-09T18:24:10.256632+0000","last_peered":"2026-03-09T18:24:10.256632+0000","last_clean":"2026-03-09T18:24:10.256632+0000","last_became_active":"2026-03-09T18:24:07.226679+0000","last_became_peered":"2026-03-09T18:24:07.226679+0000","last_unstale":"2026-03-09T18:24:10.256632+0000","last_undegraded":"2026-03-09T18:24:10.256632+0000","last_fullsized":"2026-03-09T18:24:10.256632+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:21:55.827439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.239880+0000","last_change":"2026-03-09T18:24:09.224674+0000","last_active":"2026-03-09T18:24:10.239880+0000","last_peered":"2026-03-09T18:24:10.239880+0000","last_clean":"2026-03-09T18:24:10.239880+0000","last_became_active":"2026-03-09T18:24:09.224460+0000","last_became_peered":"2026-03-09T18:24:09.224460+0000","last_unstale":"2026-03-09T18:24:10.239880+0000","last_undegraded":"2026-03-09T18:24:10.239880+0000","last_fullsized":"2026-03-09T18:24:10.239880+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T06:06:17.660160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"56'16","reported_seq":48,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671772+0000","last_change":"2026-03-09T18:24:05.699538+0000","last_active":"2026-03-09T18:24:13.671772+0000","last_peered":"2026-03-09T18:24:13.671772+0000","last_clean":"2026-03-09T18:24:13.671772+0000","last_became_active":"2026-03-09T18:24:05.699038+0000","last_became_peered":"2026-03-09T18:24:05.699038+0000","last_unstale":"2026-03-09T18:24:13.671772+0000","last_undegraded":"2026-03-09T18:24:13.671772+0000","last_fullsized":"2026-03-09T18:24:13.671772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T02:25:16.457417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222983+0000","last_change":"2026-03-09T18:24:03.185064+0000","last_active":"2026-03-09T18:24:10.222983+0000","last_peered":"2026-03-09T18:24:10.222983+0000","last_clean":"2026-03-09T18:24:10.222983+0000","last_became_active":"2026-03-09T18:24:03.184894+0000","last_became_peered":"2026-03-09T18:24:03.184894+0000","last_unstale":"2026-03-09T18:24:10.222983+0000","last_undegraded":"2026-03-09T18:24:10.222983+0000","last_fullsized":"2026-03-09T18:24:10.222983+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:46:02.551821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.247244+0000","last_change":"2026-03-09T18:23:59.124644+0000","last_active":"2026-03-09T18:24:10.247244+0000","last_peered":"2026-03-09T18:24:10.247244+0000","last_clean":"2026-03-09T18:24:10.247244+0000","last_became_active":"2026-03-09T18:23:59.118433+0000","last_became_peered":"2026-03-09T18:23:59.118433+0000","last_unstale":"2026-03-09T18:24:10.247244+0000","last_undegraded":"2026-03-09T18:24:10.247244+0000","last_fullsized":"2026-03-09T18:24:10.247244+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:22:56.440211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:22:56.440211+0000","last_clean_scrub_stamp":"2026-03-09T18:22:56.440211+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:20:32.186367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.247288+0000","last_change":"2026-03-09T18:24:07.239672+0000","last_active":"2026-03-09T18:24:10.247288+0000","last_peered":"2026-03-09T18:24:10.247288+0000","last_clean":"2026-03-09T18:24:10.247288+0000","last_became_active":"2026-03-09T18:24:07.235470+0000","last_became_peered":"2026-03-09T18:24:07.235470+0000","last_unstale":"2026-03-09T18:24:10.247288+0000","last_undegraded":"2026-03-09T18:24:10.247288+0000","last_fullsized":"2026-03-09T18:24:10.247288+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T02:38:37.498887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256471+0000","last_change":"2026-03-09T18:24:09.237425+0000","last_active":"2026-03-09T18:24:10.256471+0000","last_peered":"2026-03-09T18:24:10.256471+0000","last_clean":"2026-03-09T18:24:10.256471+0000","last_became_active":"2026-03-09T18:24:09.237235+0000","last_became_peered":"2026-03-09T18:24:09.237235+0000","last_unstale":"2026-03-09T18:24:10.256471+0000","last_undegraded":"2026-03-09T18:24:10.256471+0000","last_fullsized":"2026-03-09T18:24:10.256471+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T06:22:23.531767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"56'11","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605608+0000","last_change":"2026-03-09T18:24:05.196431+0000","last_active":"2026-03-09T18:24:13.605608+0000","last_peered":"2026-03-09T18:24:13.605608+0000","last_clean":"2026-03-09T18:24:13.605608+0000","last_became_active":"2026-03-09T18:24:05.195745+0000","last_became_peered":"2026-03-09T18:24:05.195745+0000","last_unstale":"2026-03-09T18:24:13.605608+0000","last_undegraded":"2026-03-09T18:24:13.605608+0000","last_fullsized":"2026-03-09T18:24:13.605608+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:20:35.713969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"49'1","reported_seq":33,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605657+0000","last_change":"2026-03-09T18:24:03.205871+0000","last_active":"2026-03-09T18:24:13.605657+0000","last_peered":"2026-03-09T18:24:13.605657+0000","last_clean":"2026-03-09T18:24:13.605657+0000","last_became_active":"2026-03-09T18:24:03.205793+0000","last_became_peered":"2026-03-09T18:24:03.205793+0000","last_unstale":"2026-03-09T18:24:13.605657+0000","last_undegraded":"2026-03-09T18:24:13.605657+0000","last_fullsized":"2026-03-09T18:24:13.605657+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:43:24.997286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256985+0000","last_change":"2026-03-09T18:24:07.241887+0000","last_active":"2026-03-09T18:24:10.256985+0000","last_peered":"2026-03-09T18:24:10.256985+0000","last_clean":"2026-03-09T18:24:10.256985+0000","last_became_active":"2026-03-09T18:24:07.241802+0000","last_became_peered":"2026-03-09T18:24:07.241802+0000","last_unstale":"2026-03-09T18:24:10.256985+0000","last_undegraded":"2026-03-09T18:24:10.256985+0000","last_fullsized":"2026-03-09T18:24:10.256985+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:28:59.012783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222687+0000","last_change":"2026-03-09T18:24:09.557153+0000","last_active":"2026-03-09T18:24:10.222687+0000","last_peered":"2026-03-09T18:24:10.222687+0000","last_clean":"2026-03-09T18:24:10.222687+0000","last_became_active":"2026-03-09T18:24:09.556947+0000","last_became_peered":"2026-03-09T18:24:09.556947+0000","last_unstale":"2026-03-09T18:24:10.222687+0000","last_undegraded":"2026-03-09T18:24:10.222687+0000","last_fullsized":"2026-03-09T18:24:10.222687+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:12:17.883719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"56'17","reported_seq":51,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605918+0000","last_change":"2026-03-09T18:24:05.204761+0000","last_active":"2026-03-09T18:24:13.605918+0000","last_peered":"2026-03-09T18:24:13.605918+0000","last_clean":"2026-03-09T18:24:13.605918+0000","last_became_active":"2026-03-09T18:24:05.200091+0000","last_became_peered":"2026-03-09T18:24:05.200091+0000","last_unstale":"2026-03-09T18:24:13.605918+0000","last_undegraded":"2026-03-09T18:24:13.605918+0000","last_fullsized":"2026-03-09T18:24:13.605918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T18:58:04.679103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.672154+0000","last_change":"2026-03-09T18:24:03.189486+0000","last_active":"2026-03-09T18:24:13.672154+0000","last_peered":"2026-03-09T18:24:13.672154+0000","last_clean":"2026-03-09T18:24:13.672154+0000","last_became_active":"2026-03-09T18:24:03.189408+0000","last_became_peered":"2026-03-09T18:24:03.189408+0000","last_unstale":"2026-03-09T18:24:13.672154+0000","last_undegraded":"2026-03-09T18:24:13.672154+0000","last_fullsized":"2026-03-09T18:24:13.672154+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:35:44.944243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.240106+0000","last_change":"2026-03-09T18:24:07.224576+0000","last_active":"2026-03-09T18:24:10.240106+0000","last_peered":"2026-03-09T18:24:10.240106+0000","last_clean":"2026-03-09T18:24:10.240106+0000","last_became_active":"2026-03-09T18:24:07.224309+0000","last_became_peered":"2026-03-09T18:24:07.224309+0000","last_unstale":"2026-03-09T18:24:10.240106+0000","last_undegraded":"2026-03-09T18:24:10.240106+0000","last_fullsized":"2026-03-09T18:24:10.240106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:32:58.948498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.231460+0000","last_change":"2026-03-09T18:24:09.251790+0000","last_active":"2026-03-09T18:24:10.231460+0000","last_peered":"2026-03-09T18:24:10.231460+0000","last_clean":"2026-03-09T18:24:10.231460+0000","last_became_active":"2026-03-09T18:24:09.251702+0000","last_became_peered":"2026-03-09T18:24:09.251702+0000","last_unstale":"2026-03-09T18:24:10.231460+0000","last_undegraded":"2026-03-09T18:24:10.231460+0000","last_fullsized":"2026-03-09T18:24:10.231460+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T23:22:13.476100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"56'10","reported_seq":38,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605909+0000","last_change":"2026-03-09T18:24:05.200333+0000","last_active":"2026-03-09T18:24:13.605909+0000","last_peered":"2026-03-09T18:24:13.605909+0000","last_clean":"2026-03-09T18:24:13.605909+0000","last_became_active":"2026-03-09T18:24:05.197692+0000","last_became_peered":"2026-03-09T18:24:05.197692+0000","last_unstale":"2026-03-09T18:24:13.605909+0000","last_undegraded":"2026-03-09T18:24:13.605909+0000","last_fullsized":"2026-03-09T18:24:13.605909+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:00:13.706979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222873+0000","last_change":"2026-03-09T18:24:03.199754+0000","last_active":"2026-03-09T18:24:10.222873+0000","last_peered":"2026-03-09T18:24:10.222873+0000","last_clean":"2026-03-09T18:24:10.222873+0000","last_became_active":"2026-03-09T18:24:03.194716+0000","last_became_peered":"2026-03-09T18:24:03.194716+0000","last_unstale":"2026-03-09T18:24:10.222873+0000","last_undegraded":"2026-03-09T18:24:10.222873+0000","last_fullsized":"2026-03-09T18:24:10.222873+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:54:38.755670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"56'8","reported_seq":30,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.569116+0000","last_change":"2026-03-09T18:24:07.227534+0000","last_active":"2026-03-09T18:24:10.569116+0000","last_peered":"2026-03-09T18:24:10.569116+0000","last_clean":"2026-03-09T18:24:10.569116+0000","last_became_active":"2026-03-09T18:24:07.227326+0000","last_became_peered":"2026-03-09T18:24:07.227326+0000","last_unstale":"2026-03-09T18:24:10.569116+0000","last_undegraded":"2026-03-09T18:24:10.569116+0000","last_fullsized":"2026-03-09T18:24:10.569116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T06:10:06.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605738+0000","last_change":"2026-03-09T18:24:09.244636+0000","last_active":"2026-03-09T18:24:13.605738+0000","last_peered":"2026-03-09T18:24:13.605738+0000","last_clean":"2026-03-09T18:24:13.605738+0000","last_became_active":"2026-03-09T18:24:09.244467+0000","last_became_peered":"2026-03-09T18:24:09.244467+0000","last_unstale":"2026-03-09T18:24:13.605738+0000","last_undegraded":"2026-03-09T18:24:13.605738+0000","last_fullsized":"2026-03-09T18:24:13.605738+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:00:42.437702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"56'9","reported_seq":39,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671325+0000","last_change":"2026-03-09T18:24:05.218928+0000","last_active":"2026-03-09T18:24:13.671325+0000","last_peered":"2026-03-09T18:24:13.671325+0000","last_clean":"2026-03-09T18:24:13.671325+0000","last_became_active":"2026-03-09T18:24:05.218827+0000","last_became_peered":"2026-03-09T18:24:05.218827+0000","last_unstale":"2026-03-09T18:24:13.671325+0000","last_undegraded":"2026-03-09T18:24:13.671325+0000","last_fullsized":"2026-03-09T18:24:13.671325+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T18:26:05.594380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256678+0000","last_change":"2026-03-09T18:24:03.201628+0000","last_active":"2026-03-09T18:24:10.256678+0000","last_peered":"2026-03-09T18:24:10.256678+0000","last_clean":"2026-03-09T18:24:10.256678+0000","last_became_active":"2026-03-09T18:24:03.201497+0000","last_became_peered":"2026-03-09T18:24:03.201497+0000","last_unstale":"2026-03-09T18:24:10.256678+0000","last_undegraded":"2026-03-09T18:24:10.256678+0000","last_fullsized":"2026-03-09T18:24:10.256678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:23:55.215925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.227489+0000","last_change":"2026-03-09T18:24:07.224368+0000","last_active":"2026-03-09T18:24:10.227489+0000","last_peered":"2026-03-09T18:24:10.227489+0000","last_clean":"2026-03-09T18:24:10.227489+0000","last_became_active":"2026-03-09T18:24:07.223915+0000","last_became_peered":"2026-03-09T18:24:07.223915+0000","last_unstale":"2026-03-09T18:24:10.227489+0000","last_undegraded":"2026-03-09T18:24:10.227489+0000","last_fullsized":"2026-03-09T18:24:10.227489+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:44:47.759567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671288+0000","last_change":"2026-03-09T18:24:09.244267+0000","last_active":"2026-03-09T18:24:13.671288+0000","last_peered":"2026-03-09T18:24:13.671288+0000","last_clean":"2026-03-09T18:24:13.671288+0000","last_became_active":"2026-03-09T18:24:09.244142+0000","last_became_peered":"2026-03-09T18:24:09.244142+0000","last_unstale":"2026-03-09T18:24:13.671288+0000","last_undegraded":"2026-03-09T18:24:13.671288+0000","last_fullsized":"2026-03-09T18:24:13.671288+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:18:56.112517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"56'19","reported_seq":54,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.672320+0000","last_change":"2026-03-09T18:24:05.699674+0000","last_active":"2026-03-09T18:24:13.672320+0000","last_peered":"2026-03-09T18:24:13.672320+0000","last_clean":"2026-03-09T18:24:13.672320+0000","last_became_active":"2026-03-09T18:24:05.699368+0000","last_became_peered":"2026-03-09T18:24:05.699368+0000","last_unstale":"2026-03-09T18:24:13.672320+0000","last_undegraded":"2026-03-09T18:24:13.672320+0000","last_fullsized":"2026-03-09T18:24:13.672320+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:47:50.243024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.247206+0000","last_change":"2026-03-09T18:24:03.207195+0000","last_active":"2026-03-09T18:24:10.247206+0000","last_peered":"2026-03-09T18:24:10.247206+0000","last_clean":"2026-03-09T18:24:10.247206+0000","last_became_active":"2026-03-09T18:24:03.205891+0000","last_became_peered":"2026-03-09T18:24:03.205891+0000","last_unstale":"2026-03-09T18:24:10.247206+0000","last_undegraded":"2026-03-09T18:24:10.247206+0000","last_fullsized":"2026-03-09T18:24:10.247206+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T23:30:00.371442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.227921+0000","last_change":"2026-03-09T18:24:07.227722+0000","last_active":"2026-03-09T18:24:10.227921+0000","last_peered":"2026-03-09T18:24:10.227921+0000","last_clean":"2026-03-09T18:24:10.227921+0000","last_became_active":"2026-03-09T18:24:07.227564+0000","last_became_peered":"2026-03-09T18:24:07.227564+0000","last_unstale":"2026-03-09T18:24:10.227921+0000","last_undegraded":"2026-03-09T18:24:10.227921+0000","last_fullsized":"2026-03-09T18:24:10.227921+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:39:23.479230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.247192+0000","last_change":"2026-03-09T18:24:09.243922+0000","last_active":"2026-03-09T18:24:10.247192+0000","last_peered":"2026-03-09T18:24:10.247192+0000","last_clean":"2026-03-09T18:24:10.247192+0000","last_became_active":"2026-03-09T18:24:09.243767+0000","last_became_peered":"2026-03-09T18:24:09.243767+0000","last_unstale":"2026-03-09T18:24:10.247192+0000","last_undegraded":"2026-03-09T18:24:10.247192+0000","last_fullsized":"2026-03-09T18:24:10.247192+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:21:20.502452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"56'12","reported_seq":46,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.606260+0000","last_change":"2026-03-09T18:24:05.200969+0000","last_active":"2026-03-09T18:24:13.606260+0000","last_peered":"2026-03-09T18:24:13.606260+0000","last_clean":"2026-03-09T18:24:13.606260+0000","last_became_active":"2026-03-09T18:24:05.197302+0000","last_became_peered":"2026-03-09T18:24:05.197302+0000","last_unstale":"2026-03-09T18:24:13.606260+0000","last_undegraded":"2026-03-09T18:24:13.606260+0000","last_fullsized":"2026-03-09T18:24:13.606260+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:11:31.543493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.247118+0000","last_change":"2026-03-09T18:24:03.207973+0000","last_active":"2026-03-09T18:24:10.247118+0000","last_peered":"2026-03-09T18:24:10.247118+0000","last_clean":"2026-03-09T18:24:10.247118+0000","last_became_active":"2026-03-09T18:24:03.207856+0000","last_became_peered":"2026-03-09T18:24:03.207856+0000","last_unstale":"2026-03-09T18:24:10.247118+0000","last_undegraded":"2026-03-09T18:24:10.247118+0000","last_fullsized":"2026-03-09T18:24:10.247118+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:30:10.752732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.227441+0000","last_change":"2026-03-09T18:24:07.216714+0000","last_active":"2026-03-09T18:24:10.227441+0000","last_peered":"2026-03-09T18:24:10.227441+0000","last_clean":"2026-03-09T18:24:10.227441+0000","last_became_active":"2026-03-09T18:24:07.216610+0000","last_became_peered":"2026-03-09T18:24:07.216610+0000","last_unstale":"2026-03-09T18:24:10.227441+0000","last_undegraded":"2026-03-09T18:24:10.227441+0000","last_fullsized":"2026-03-09T18:24:10.227441+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:39:09.838212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223512+0000","last_change":"2026-03-09T18:24:09.236682+0000","last_active":"2026-03-09T18:24:10.223512+0000","last_peered":"2026-03-09T18:24:10.223512+0000","last_clean":"2026-03-09T18:24:10.223512+0000","last_became_active":"2026-03-09T18:24:09.231385+0000","last_became_peered":"2026-03-09T18:24:09.231385+0000","last_unstale":"2026-03-09T18:24:10.223512+0000","last_undegraded":"2026-03-09T18:24:10.223512+0000","last_fullsized":"2026-03-09T18:24:10.223512+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:18:36.241588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"56'15","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.946529+0000","last_change":"2026-03-09T18:24:05.701723+0000","last_active":"2026-03-09T18:24:10.946529+0000","last_peered":"2026-03-09T18:24:10.946529+0000","last_clean":"2026-03-09T18:24:10.946529+0000","last_became_active":"2026-03-09T18:24:05.701555+0000","last_became_peered":"2026-03-09T18:24:05.701555+0000","last_unstale":"2026-03-09T18:24:10.946529+0000","last_undegraded":"2026-03-09T18:24:10.946529+0000","last_fullsized":"2026-03-09T18:24:10.946529+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:58:05.928460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"49'2","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.426908+0000","last_change":"2026-03-09T18:24:03.207918+0000","last_active":"2026-03-09T18:24:10.426908+0000","last_peered":"2026-03-09T18:24:10.426908+0000","last_clean":"2026-03-09T18:24:10.426908+0000","last_became_active":"2026-03-09T18:24:03.207600+0000","last_became_peered":"2026-03-09T18:24:03.207600+0000","last_unstale":"2026-03-09T18:24:10.426908+0000","last_undegraded":"2026-03-09T18:24:10.426908+0000","last_fullsized":"2026-03-09T18:24:10.426908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:30:09.650183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"56'8","reported_seq":28,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.573472+0000","last_change":"2026-03-09T18:24:07.225626+0000","last_active":"2026-03-09T18:24:10.573472+0000","last_peered":"2026-03-09T18:24:10.573472+0000","last_clean":"2026-03-09T18:24:10.573472+0000","last_became_active":"2026-03-09T18:24:07.225349+0000","last_became_peered":"2026-03-09T18:24:07.225349+0000","last_unstale":"2026-03-09T18:24:10.573472+0000","last_undegraded":"2026-03-09T18:24:10.573472+0000","last_fullsized":"2026-03-09T18:24:10.573472+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:03:40.680785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256472+0000","last_change":"2026-03-09T18:24:09.553776+0000","last_active":"2026-03-09T18:24:10.256472+0000","last_peered":"2026-03-09T18:24:10.256472+0000","last_clean":"2026-03-09T18:24:10.256472+0000","last_became_active":"2026-03-09T18:24:09.553571+0000","last_became_peered":"2026-03-09T18:24:09.553571+0000","last_unstale":"2026-03-09T18:24:10.256472+0000","last_undegraded":"2026-03-09T18:24:10.256472+0000","last_fullsized":"2026-03-09T18:24:10.256472+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T23:56:15.529841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.672140+0000","last_change":"2026-03-09T18:24:03.196586+0000","last_active":"2026-03-09T18:24:13.672140+0000","last_peered":"2026-03-09T18:24:13.672140+0000","last_clean":"2026-03-09T18:24:13.672140+0000","last_became_active":"2026-03-09T18:24:03.196485+0000","last_became_peered":"2026-03-09T18:24:03.196485+0000","last_unstale":"2026-03-09T18:24:13.672140+0000","last_undegraded":"2026-03-09T18:24:13.672140+0000","last_fullsized":"2026-03-09T18:24:13.672140+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:45:22.631661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"56'6","reported_seq":30,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.965727+0000","last_change":"2026-03-09T18:24:05.702342+0000","last_active":"2026-03-09T18:24:10.965727+0000","last_peered":"2026-03-09T18:24:10.965727+0000","last_clean":"2026-03-09T18:24:10.965727+0000","last_became_active":"2026-03-09T18:24:05.702245+0000","last_became_peered":"2026-03-09T18:24:05.702245+0000","last_unstale":"2026-03-09T18:24:10.965727+0000","last_undegraded":"2026-03-09T18:24:10.965727+0000","last_fullsized":"2026-03-09T18:24:10.965727+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:54:23.031427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256718+0000","last_change":"2026-03-09T18:24:07.226870+0000","last_active":"2026-03-09T18:24:10.256718+0000","last_peered":"2026-03-09T18:24:10.256718+0000","last_clean":"2026-03-09T18:24:10.256718+0000","last_became_active":"2026-03-09T18:24:07.226577+0000","last_became_peered":"2026-03-09T18:24:07.226577+0000","last_unstale":"2026-03-09T18:24:10.256718+0000","last_undegraded":"2026-03-09T18:24:10.256718+0000","last_fullsized":"2026-03-09T18:24:10.256718+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:10:12.638292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.247552+0000","last_change":"2026-03-09T18:24:09.556749+0000","last_active":"2026-03-09T18:24:10.247552+0000","last_peered":"2026-03-09T18:24:10.247552+0000","last_clean":"2026-03-09T18:24:10.247552+0000","last_became_active":"2026-03-09T18:24:09.556628+0000","last_became_peered":"2026-03-09T18:24:09.556628+0000","last_unstale":"2026-03-09T18:24:10.247552+0000","last_undegraded":"2026-03-09T18:24:10.247552+0000","last_fullsized":"2026-03-09T18:24:10.247552+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:34:31.350991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"56'9","reported_seq":39,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671355+0000","last_change":"2026-03-09T18:24:05.699196+0000","last_active":"2026-03-09T18:24:13.671355+0000","last_peered":"2026-03-09T18:24:13.671355+0000","last_clean":"2026-03-09T18:24:13.671355+0000","last_became_active":"2026-03-09T18:24:05.698853+0000","last_became_peered":"2026-03-09T18:24:05.698853+0000","last_unstale":"2026-03-09T18:24:13.671355+0000","last_undegraded":"2026-03-09T18:24:13.671355+0000","last_fullsized":"2026-03-09T18:24:13.671355+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:16:23.156092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.246967+0000","last_change":"2026-03-09T18:24:03.207568+0000","last_active":"2026-03-09T18:24:10.246967+0000","last_peered":"2026-03-09T18:24:10.246967+0000","last_clean":"2026-03-09T18:24:10.246967+0000","last_became_active":"2026-03-09T18:24:03.207431+0000","last_became_peered":"2026-03-09T18:24:03.207431+0000","last_unstale":"2026-03-09T18:24:10.246967+0000","last_undegraded":"2026-03-09T18:24:10.246967+0000","last_fullsized":"2026-03-09T18:24:10.246967+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:02:35.434653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222776+0000","last_change":"2026-03-09T18:24:07.217336+0000","last_active":"2026-03-09T18:24:10.222776+0000","last_peered":"2026-03-09T18:24:10.222776+0000","last_clean":"2026-03-09T18:24:10.222776+0000","last_became_active":"2026-03-09T18:24:07.217177+0000","last_became_peered":"2026-03-09T18:24:07.217177+0000","last_unstale":"2026-03-09T18:24:10.222776+0000","last_undegraded":"2026-03-09T18:24:10.222776+0000","last_fullsized":"2026-03-09T18:24:10.222776+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:32:26.680381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222115+0000","last_change":"2026-03-09T18:24:09.243608+0000","last_active":"2026-03-09T18:24:10.222115+0000","last_peered":"2026-03-09T18:24:10.222115+0000","last_clean":"2026-03-09T18:24:10.222115+0000","last_became_active":"2026-03-09T18:24:09.243240+0000","last_became_peered":"2026-03-09T18:24:09.243240+0000","last_unstale":"2026-03-09T18:24:10.222115+0000","last_undegraded":"2026-03-09T18:24:10.222115+0000","last_fullsized":"2026-03-09T18:24:10.222115+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:16:23.304982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"56'9","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.990909+0000","last_change":"2026-03-09T18:24:05.700166+0000","last_active":"2026-03-09T18:24:10.990909+0000","last_peered":"2026-03-09T18:24:10.990909+0000","last_clean":"2026-03-09T18:24:10.990909+0000","last_became_active":"2026-03-09T18:24:05.700039+0000","last_became_peered":"2026-03-09T18:24:05.700039+0000","last_unstale":"2026-03-09T18:24:10.990909+0000","last_undegraded":"2026-03-09T18:24:10.990909+0000","last_fullsized":"2026-03-09T18:24:10.990909+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:23:38.153149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670764+0000","last_change":"2026-03-09T18:24:03.208339+0000","last_active":"2026-03-09T18:24:13.670764+0000","last_peered":"2026-03-09T18:24:13.670764+0000","last_clean":"2026-03-09T18:24:13.670764+0000","last_became_active":"2026-03-09T18:24:03.205829+0000","last_became_peered":"2026-03-09T18:24:03.205829+0000","last_unstale":"2026-03-09T18:24:13.670764+0000","last_undegraded":"2026-03-09T18:24:13.670764+0000","last_fullsized":"2026-03-09T18:24:13.670764+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:31:43.899273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"56'8","reported_seq":28,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.572169+0000","last_change":"2026-03-09T18:24:07.207074+0000","last_active":"2026-03-09T18:24:10.572169+0000","last_peered":"2026-03-09T18:24:10.572169+0000","last_clean":"2026-03-09T18:24:10.572169+0000","last_became_active":"2026-03-09T18:24:07.206931+0000","last_became_peered":"2026-03-09T18:24:07.206931+0000","last_unstale":"2026-03-09T18:24:10.572169+0000","last_undegraded":"2026-03-09T18:24:10.572169+0000","last_fullsized":"2026-03-09T18:24:10.572169+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:39:17.281302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605054+0000","last_change":"2026-03-09T18:24:09.246051+0000","last_active":"2026-03-09T18:24:13.605054+0000","last_peered":"2026-03-09T18:24:13.605054+0000","last_clean":"2026-03-09T18:24:13.605054+0000","last_became_active":"2026-03-09T18:24:09.245653+0000","last_became_peered":"2026-03-09T18:24:09.245653+0000","last_unstale":"2026-03-09T18:24:13.605054+0000","last_undegraded":"2026-03-09T18:24:13.605054+0000","last_fullsized":"2026-03-09T18:24:13.605054+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:14:13.704927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"56'10","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.987198+0000","last_change":"2026-03-09T18:24:05.700180+0000","last_active":"2026-03-09T18:24:10.987198+0000","last_peered":"2026-03-09T18:24:10.987198+0000","last_clean":"2026-03-09T18:24:10.987198+0000","last_became_active":"2026-03-09T18:24:05.699788+0000","last_became_peered":"2026-03-09T18:24:05.699788+0000","last_unstale":"2026-03-09T18:24:10.987198+0000","last_undegraded":"2026-03-09T18:24:10.987198+0000","last_fullsized":"2026-03-09T18:24:10.987198+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:05:53.156748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.246895+0000","last_change":"2026-03-09T18:24:03.207760+0000","last_active":"2026-03-09T18:24:10.246895+0000","last_peered":"2026-03-09T18:24:10.246895+0000","last_clean":"2026-03-09T18:24:10.246895+0000","last_became_active":"2026-03-09T18:24:03.207658+0000","last_became_peered":"2026-03-09T18:24:03.207658+0000","last_unstale":"2026-03-09T18:24:10.246895+0000","last_undegraded":"2026-03-09T18:24:10.246895+0000","last_fullsized":"2026-03-09T18:24:10.246895+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:46:54.897444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"56'8","reported_seq":27,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.508766+0000","last_change":"2026-03-09T18:24:07.226804+0000","last_active":"2026-03-09T18:24:10.508766+0000","last_peered":"2026-03-09T18:24:10.508766+0000","last_clean":"2026-03-09T18:24:10.508766+0000","last_became_active":"2026-03-09T18:24:07.226445+0000","last_became_peered":"2026-03-09T18:24:07.226445+0000","last_unstale":"2026-03-09T18:24:10.508766+0000","last_undegraded":"2026-03-09T18:24:10.508766+0000","last_fullsized":"2026-03-09T18:24:10.508766+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:27:00.805131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670462+0000","last_change":"2026-03-09T18:24:09.237903+0000","last_active":"2026-03-09T18:24:13.670462+0000","last_peered":"2026-03-09T18:24:13.670462+0000","last_clean":"2026-03-09T18:24:13.670462+0000","last_became_active":"2026-03-09T18:24:09.237798+0000","last_became_peered":"2026-03-09T18:24:09.237798+0000","last_unstale":"2026-03-09T18:24:13.670462+0000","last_undegraded":"2026-03-09T18:24:13.670462+0000","last_fullsized":"2026-03-09T18:24:13.670462+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:40:01.328498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"56'11","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605415+0000","last_change":"2026-03-09T18:24:05.196544+0000","last_active":"2026-03-09T18:24:13.605415+0000","last_peered":"2026-03-09T18:24:13.605415+0000","last_clean":"2026-03-09T18:24:13.605415+0000","last_became_active":"2026-03-09T18:24:05.196078+0000","last_became_peered":"2026-03-09T18:24:05.196078+0000","last_unstale":"2026-03-09T18:24:13.605415+0000","last_undegraded":"2026-03-09T18:24:13.605415+0000","last_fullsized":"2026-03-09T18:24:13.605415+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:56:29.132463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605391+0000","last_change":"2026-03-09T18:24:03.209595+0000","last_active":"2026-03-09T18:24:13.605391+0000","last_peered":"2026-03-09T18:24:13.605391+0000","last_clean":"2026-03-09T18:24:13.605391+0000","last_became_active":"2026-03-09T18:24:03.209470+0000","last_became_peered":"2026-03-09T18:24:03.209470+0000","last_unstale":"2026-03-09T18:24:13.605391+0000","last_undegraded":"2026-03-09T18:24:13.605391+0000","last_fullsized":"2026-03-09T18:24:13.605391+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:47:06.372658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.240364+0000","last_change":"2026-03-09T18:24:07.232513+0000","last_active":"2026-03-09T18:24:10.240364+0000","last_peered":"2026-03-09T18:24:10.240364+0000","last_clean":"2026-03-09T18:24:10.240364+0000","last_became_active":"2026-03-09T18:24:07.232136+0000","last_became_peered":"2026-03-09T18:24:07.232136+0000","last_unstale":"2026-03-09T18:24:10.240364+0000","last_undegraded":"2026-03-09T18:24:10.240364+0000","last_fullsized":"2026-03-09T18:24:10.240364+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T18:32:44.982164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.543677+0000","last_change":"2026-03-09T18:24:09.231904+0000","last_active":"2026-03-09T18:24:10.543677+0000","last_peered":"2026-03-09T18:24:10.543677+0000","last_clean":"2026-03-09T18:24:10.543677+0000","last_became_active":"2026-03-09T18:24:09.231807+0000","last_became_peered":"2026-03-09T18:24:09.231807+0000","last_unstale":"2026-03-09T18:24:10.543677+0000","last_undegraded":"2026-03-09T18:24:10.543677+0000","last_fullsized":"2026-03-09T18:24:10.543677+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:38:53.618664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"56'9","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.840672+0000","last_change":"2026-03-09T18:24:05.221190+0000","last_active":"2026-03-09T18:24:10.840672+0000","last_peered":"2026-03-09T18:24:10.840672+0000","last_clean":"2026-03-09T18:24:10.840672+0000","last_became_active":"2026-03-09T18:24:05.209831+0000","last_became_peered":"2026-03-09T18:24:05.209831+0000","last_unstale":"2026-03-09T18:24:10.840672+0000","last_undegraded":"2026-03-09T18:24:10.840672+0000","last_fullsized":"2026-03-09T18:24:10.840672+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:28:20.138287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.246851+0000","last_change":"2026-03-09T18:24:03.208284+0000","last_active":"2026-03-09T18:24:10.246851+0000","last_peered":"2026-03-09T18:24:10.246851+0000","last_clean":"2026-03-09T18:24:10.246851+0000","last_became_active":"2026-03-09T18:24:03.208172+0000","last_became_peered":"2026-03-09T18:24:03.208172+0000","last_unstale":"2026-03-09T18:24:10.246851+0000","last_undegraded":"2026-03-09T18:24:10.246851+0000","last_fullsized":"2026-03-09T18:24:10.246851+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T18:49:15.426350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223446+0000","last_change":"2026-03-09T18:24:07.220189+0000","last_active":"2026-03-09T18:24:10.223446+0000","last_peered":"2026-03-09T18:24:10.223446+0000","last_clean":"2026-03-09T18:24:10.223446+0000","last_became_active":"2026-03-09T18:24:07.220058+0000","last_became_peered":"2026-03-09T18:24:07.220058+0000","last_unstale":"2026-03-09T18:24:10.223446+0000","last_undegraded":"2026-03-09T18:24:10.223446+0000","last_fullsized":"2026-03-09T18:24:10.223446+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:20:14.532057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670534+0000","last_change":"2026-03-09T18:24:09.238768+0000","last_active":"2026-03-09T18:24:13.670534+0000","last_peered":"2026-03-09T18:24:13.670534+0000","last_clean":"2026-03-09T18:24:13.670534+0000","last_became_active":"2026-03-09T18:24:09.238607+0000","last_became_peered":"2026-03-09T18:24:09.238607+0000","last_unstale":"2026-03-09T18:24:13.670534+0000","last_undegraded":"2026-03-09T18:24:13.670534+0000","last_fullsized":"2026-03-09T18:24:13.670534+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:56:49.887205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"56'11","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:11.044461+0000","last_change":"2026-03-09T18:24:05.700051+0000","last_active":"2026-03-09T18:24:11.044461+0000","last_peered":"2026-03-09T18:24:11.044461+0000","last_clean":"2026-03-09T18:24:11.044461+0000","last_became_active":"2026-03-09T18:24:05.699627+0000","last_became_peered":"2026-03-09T18:24:05.699627+0000","last_unstale":"2026-03-09T18:24:11.044461+0000","last_undegraded":"2026-03-09T18:24:11.044461+0000","last_fullsized":"2026-03-09T18:24:11.044461+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:29:13.226323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256609+0000","last_change":"2026-03-09T18:24:03.203571+0000","last_active":"2026-03-09T18:24:10.256609+0000","last_peered":"2026-03-09T18:24:10.256609+0000","last_clean":"2026-03-09T18:24:10.256609+0000","last_became_active":"2026-03-09T18:24:03.203466+0000","last_became_peered":"2026-03-09T18:24:03.203466+0000","last_unstale":"2026-03-09T18:24:10.256609+0000","last_undegraded":"2026-03-09T18:24:10.256609+0000","last_fullsized":"2026-03-09T18:24:10.256609+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T06:04:38.142520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.246735+0000","last_change":"2026-03-09T18:24:07.225732+0000","last_active":"2026-03-09T18:24:10.246735+0000","last_peered":"2026-03-09T18:24:10.246735+0000","last_clean":"2026-03-09T18:24:10.246735+0000","last_became_active":"2026-03-09T18:24:07.225544+0000","last_became_peered":"2026-03-09T18:24:07.225544+0000","last_unstale":"2026-03-09T18:24:10.246735+0000","last_undegraded":"2026-03-09T18:24:10.246735+0000","last_fullsized":"2026-03-09T18:24:10.246735+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:00:53.834199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223560+0000","last_change":"2026-03-09T18:24:09.554047+0000","last_active":"2026-03-09T18:24:10.223560+0000","last_peered":"2026-03-09T18:24:10.223560+0000","last_clean":"2026-03-09T18:24:10.223560+0000","last_became_active":"2026-03-09T18:24:09.553575+0000","last_became_peered":"2026-03-09T18:24:09.553575+0000","last_unstale":"2026-03-09T18:24:10.223560+0000","last_undegraded":"2026-03-09T18:24:10.223560+0000","last_fullsized":"2026-03-09T18:24:10.223560+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:30:09.614302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"56'4","reported_seq":27,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.660316+0000","last_change":"2026-03-09T18:24:05.211464+0000","last_active":"2026-03-09T18:24:10.660316+0000","last_peered":"2026-03-09T18:24:10.660316+0000","last_clean":"2026-03-09T18:24:10.660316+0000","last_became_active":"2026-03-09T18:24:05.211104+0000","last_became_peered":"2026-03-09T18:24:05.211104+0000","last_unstale":"2026-03-09T18:24:10.660316+0000","last_undegraded":"2026-03-09T18:24:10.660316+0000","last_fullsized":"2026-03-09T18:24:10.660316+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:40:04.637449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670703+0000","last_change":"2026-03-09T18:24:03.213642+0000","last_active":"2026-03-09T18:24:13.670703+0000","last_peered":"2026-03-09T18:24:13.670703+0000","last_clean":"2026-03-09T18:24:13.670703+0000","last_became_active":"2026-03-09T18:24:03.213408+0000","last_became_peered":"2026-03-09T18:24:03.213408+0000","last_unstale":"2026-03-09T18:24:13.670703+0000","last_undegraded":"2026-03-09T18:24:13.670703+0000","last_fullsized":"2026-03-09T18:24:13.670703+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:33:12.351115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.672808+0000","last_change":"2026-03-09T18:24:07.228975+0000","last_active":"2026-03-09T18:24:13.672808+0000","last_peered":"2026-03-09T18:24:13.672808+0000","last_clean":"2026-03-09T18:24:13.672808+0000","last_became_active":"2026-03-09T18:24:07.228789+0000","last_became_peered":"2026-03-09T18:24:07.228789+0000","last_unstale":"2026-03-09T18:24:13.672808+0000","last_undegraded":"2026-03-09T18:24:13.672808+0000","last_fullsized":"2026-03-09T18:24:13.672808+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T06:15:20.634499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.246569+0000","last_change":"2026-03-09T18:24:09.247222+0000","last_active":"2026-03-09T18:24:10.246569+0000","last_peered":"2026-03-09T18:24:10.246569+0000","last_clean":"2026-03-09T18:24:10.246569+0000","last_became_active":"2026-03-09T18:24:09.247123+0000","last_became_peered":"2026-03-09T18:24:09.247123+0000","last_unstale":"2026-03-09T18:24:10.246569+0000","last_undegraded":"2026-03-09T18:24:10.246569+0000","last_fullsized":"2026-03-09T18:24:10.246569+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:43:28.329189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.240185+0000","last_change":"2026-03-09T18:24:09.224735+0000","last_active":"2026-03-09T18:24:10.240185+0000","last_peered":"2026-03-09T18:24:10.240185+0000","last_clean":"2026-03-09T18:24:10.240185+0000","last_became_active":"2026-03-09T18:24:09.224602+0000","last_became_peered":"2026-03-09T18:24:09.224602+0000","last_unstale":"2026-03-09T18:24:10.240185+0000","last_undegraded":"2026-03-09T18:24:10.240185+0000","last_fullsized":"2026-03-09T18:24:10.240185+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:06:04.278966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222944+0000","last_change":"2026-03-09T18:24:03.201690+0000","last_active":"2026-03-09T18:24:10.222944+0000","last_peered":"2026-03-09T18:24:10.222944+0000","last_clean":"2026-03-09T18:24:10.222944+0000","last_became_active":"2026-03-09T18:24:03.201352+0000","last_became_peered":"2026-03-09T18:24:03.201352+0000","last_unstale":"2026-03-09T18:24:10.222944+0000","last_undegraded":"2026-03-09T18:24:10.222944+0000","last_fullsized":"2026-03-09T18:24:10.222944+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:38:59.452823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"56'11","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.672232+0000","last_change":"2026-03-09T18:24:05.214358+0000","last_active":"2026-03-09T18:24:13.672232+0000","last_peered":"2026-03-09T18:24:13.672232+0000","last_clean":"2026-03-09T18:24:13.672232+0000","last_became_active":"2026-03-09T18:24:05.214262+0000","last_became_peered":"2026-03-09T18:24:05.214262+0000","last_unstale":"2026-03-09T18:24:13.672232+0000","last_undegraded":"2026-03-09T18:24:13.672232+0000","last_fullsized":"2026-03-09T18:24:13.672232+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:35:32.573607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671109+0000","last_change":"2026-03-09T18:24:07.226750+0000","last_active":"2026-03-09T18:24:13.671109+0000","last_peered":"2026-03-09T18:24:13.671109+0000","last_clean":"2026-03-09T18:24:13.671109+0000","last_became_active":"2026-03-09T18:24:07.226658+0000","last_became_peered":"2026-03-09T18:24:07.226658+0000","last_unstale":"2026-03-09T18:24:13.671109+0000","last_undegraded":"2026-03-09T18:24:13.671109+0000","last_fullsized":"2026-03-09T18:24:13.671109+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:15:56.846850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":393,"ondisk_log_size":393,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":44,"seq":188978561029,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":28028,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939396,"statfs":{"total":21470642176,"available":21441941504,"internally_reserved":0,"allocated":1224704,"data_stored":846699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1585,"internal_metadata":27457999},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":38,"seq":163208757256,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":28012,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939412,"statfs":{"total":21470642176,"available":21441957888,"internally_reserved":0,"allocated":1200128,"data_stored":845178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27457997},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920778,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27448,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939976,"statfs":{"total":21470642176,"available":21442535424,"internally_reserved":0,"allocated":618496,"data_stored":256175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084301,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27476,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939948,"statfs":{"total":21470642176,"available":21442506752,"internally_reserved":0,"allocated":651264,"data_stored":263207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247823,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27472,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939952,"statfs":{"total":21470642176,"available":21442510848,"internally_reserved":0,"allocated":651264,"data_stored":256707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27457996},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476753,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27428,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939996,"statfs":{"total":21470642176,"available":21442555904,"internally_reserved":0,"allocated":610304,"data_stored":256387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607572,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27488,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939936,"statfs":{"total":21470642176,"available":21442494464,"internally_reserved":0,"allocated":671744,"data_stored":256595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":28048,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939376,"statfs":{"total":21470642176,"available":21441921024,"internally_reserved":0,"allocated":1241088,"data_stored":853341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":2338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-09T18:24:16.741 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph pg dump --format=json 2026-03-09T18:24:16.967 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:17.184 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:17 vm03 ceph-mon[54135]: pgmap v127: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail; 75 KiB/s rd, 5.8 KiB/s wr, 183 op/s 2026-03-09T18:24:17.281 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:24:17.282 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:17 vm02 ceph-mon[50486]: pgmap v127: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail; 75 KiB/s rd, 5.8 KiB/s wr, 183 op/s 2026-03-09T18:24:17.282 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:17 vm02 ceph-mon[56210]: pgmap v127: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail; 75 KiB/s rd, 5.8 KiB/s wr, 183 op/s 2026-03-09T18:24:17.284 INFO:teuthology.orchestra.run.vm02.stderr:dumped all 2026-03-09T18:24:17.485 INFO:teuthology.orchestra.run.vm02.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2026-03-09T18:24:15.387243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596507,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":805,"num_read_kb":545,"num_write":559,"num_write_kb":2195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":565,"ondisk_log_size":565,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":389,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":167739392,"kb_used":221400,"kb_used_data":6708,"kb_used_omap":12,"kb_used_meta":214515,"kb_avail":167517992,"statfs":{"total":171765137408,"available":171538423808,"internally_reserved":0,"allocated":6868992,"data_stored":3834289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12710,"internal_metadata":219663962},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4353,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":708,"num_read_kb":464,"num_write":423,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.176668"},"pg_stats":[{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670904+0000","last_change":"2026-03-09T18:24:03.214654+0000","last_active":"2026-03-09T18:24:13.670904+0000","last_peered":"2026-03-09T18:24:13.670904+0000","last_clean":"2026-03-09T18:24:13.670904+0000","last_became_active":"2026-03-09T18:24:03.213803+0000","last_became_peered":"2026-03-09T18:24:03.213803+0000","last_unstale":"2026-03-09T18:24:13.670904+0000","last_undegraded":"2026-03-09T18:24:13.670904+0000","last_fullsized":"2026-03-09T18:24:13.670904+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:46:08.381053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"56'9","reported_seq":39,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.606426+0000","last_change":"2026-03-09T18:24:05.205753+0000","last_active":"2026-03-09T18:24:13.606426+0000","last_peered":"2026-03-09T18:24:13.606426+0000","last_clean":"2026-03-09T18:24:13.606426+0000","last_became_active":"2026-03-09T18:24:05.204876+0000","last_became_peered":"2026-03-09T18:24:05.204876+0000","last_unstale":"2026-03-09T18:24:13.606426+0000","last_undegraded":"2026-03-09T18:24:13.606426+0000","last_fullsized":"2026-03-09T18:24:13.606426+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:27:26.568932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.240437+0000","last_change":"2026-03-09T18:24:07.231940+0000","last_active":"2026-03-09T18:24:10.240437+0000","last_peered":"2026-03-09T18:24:10.240437+0000","last_clean":"2026-03-09T18:24:10.240437+0000","last_became_active":"2026-03-09T18:24:07.231783+0000","last_became_peered":"2026-03-09T18:24:07.231783+0000","last_unstale":"2026-03-09T18:24:10.240437+0000","last_undegraded":"2026-03-09T18:24:10.240437+0000","last_fullsized":"2026-03-09T18:24:10.240437+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:47:20.940484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.606398+0000","last_change":"2026-03-09T18:24:09.226383+0000","last_active":"2026-03-09T18:24:13.606398+0000","last_peered":"2026-03-09T18:24:13.606398+0000","last_clean":"2026-03-09T18:24:13.606398+0000","last_became_active":"2026-03-09T18:24:09.226245+0000","last_became_peered":"2026-03-09T18:24:09.226245+0000","last_unstale":"2026-03-09T18:24:13.606398+0000","last_undegraded":"2026-03-09T18:24:13.606398+0000","last_fullsized":"2026-03-09T18:24:13.606398+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:29:54.921532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223160+0000","last_change":"2026-03-09T18:24:09.557919+0000","last_active":"2026-03-09T18:24:10.223160+0000","last_peered":"2026-03-09T18:24:10.223160+0000","last_clean":"2026-03-09T18:24:10.223160+0000","last_became_active":"2026-03-09T18:24:09.557775+0000","last_became_peered":"2026-03-09T18:24:09.557775+0000","last_unstale":"2026-03-09T18:24:10.223160+0000","last_undegraded":"2026-03-09T18:24:10.223160+0000","last_fullsized":"2026-03-09T18:24:10.223160+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:30:19.527333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223172+0000","last_change":"2026-03-09T18:24:03.200786+0000","last_active":"2026-03-09T18:24:10.223172+0000","last_peered":"2026-03-09T18:24:10.223172+0000","last_clean":"2026-03-09T18:24:10.223172+0000","last_became_active":"2026-03-09T18:24:03.191302+0000","last_became_peered":"2026-03-09T18:24:03.191302+0000","last_unstale":"2026-03-09T18:24:10.223172+0000","last_undegraded":"2026-03-09T18:24:10.223172+0000","last_fullsized":"2026-03-09T18:24:10.223172+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:43:21.407361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"56'15","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:11.057678+0000","last_change":"2026-03-09T18:24:05.206039+0000","last_active":"2026-03-09T18:24:11.057678+0000","last_peered":"2026-03-09T18:24:11.057678+0000","last_clean":"2026-03-09T18:24:11.057678+0000","last_became_active":"2026-03-09T18:24:05.205472+0000","last_became_peered":"2026-03-09T18:24:05.205472+0000","last_unstale":"2026-03-09T18:24:11.057678+0000","last_undegraded":"2026-03-09T18:24:11.057678+0000","last_fullsized":"2026-03-09T18:24:11.057678+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:54:08.599023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605464+0000","last_change":"2026-03-09T18:24:07.231661+0000","last_active":"2026-03-09T18:24:13.605464+0000","last_peered":"2026-03-09T18:24:13.605464+0000","last_clean":"2026-03-09T18:24:13.605464+0000","last_became_active":"2026-03-09T18:24:07.231392+0000","last_became_peered":"2026-03-09T18:24:07.231392+0000","last_unstale":"2026-03-09T18:24:13.605464+0000","last_undegraded":"2026-03-09T18:24:13.605464+0000","last_fullsized":"2026-03-09T18:24:13.605464+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:24:18.946745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256529+0000","last_change":"2026-03-09T18:24:03.186217+0000","last_active":"2026-03-09T18:24:10.256529+0000","last_peered":"2026-03-09T18:24:10.256529+0000","last_clean":"2026-03-09T18:24:10.256529+0000","last_became_active":"2026-03-09T18:24:03.186022+0000","last_became_peered":"2026-03-09T18:24:03.186022+0000","last_unstale":"2026-03-09T18:24:10.256529+0000","last_undegraded":"2026-03-09T18:24:10.256529+0000","last_fullsized":"2026-03-09T18:24:10.256529+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T02:19:24.282682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"56'9","reported_seq":39,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605751+0000","last_change":"2026-03-09T18:24:05.205331+0000","last_active":"2026-03-09T18:24:13.605751+0000","last_peered":"2026-03-09T18:24:13.605751+0000","last_clean":"2026-03-09T18:24:13.605751+0000","last_became_active":"2026-03-09T18:24:05.205038+0000","last_became_peered":"2026-03-09T18:24:05.205038+0000","last_unstale":"2026-03-09T18:24:13.605751+0000","last_undegraded":"2026-03-09T18:24:13.605751+0000","last_fullsized":"2026-03-09T18:24:13.605751+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:20:18.413493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256533+0000","last_change":"2026-03-09T18:24:07.227365+0000","last_active":"2026-03-09T18:24:10.256533+0000","last_peered":"2026-03-09T18:24:10.256533+0000","last_clean":"2026-03-09T18:24:10.256533+0000","last_became_active":"2026-03-09T18:24:07.227279+0000","last_became_peered":"2026-03-09T18:24:07.227279+0000","last_unstale":"2026-03-09T18:24:10.256533+0000","last_undegraded":"2026-03-09T18:24:10.256533+0000","last_fullsized":"2026-03-09T18:24:10.256533+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:45:42.386531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670954+0000","last_change":"2026-03-09T18:24:09.238402+0000","last_active":"2026-03-09T18:24:13.670954+0000","last_peered":"2026-03-09T18:24:13.670954+0000","last_clean":"2026-03-09T18:24:13.670954+0000","last_became_active":"2026-03-09T18:24:09.238326+0000","last_became_peered":"2026-03-09T18:24:09.238326+0000","last_unstale":"2026-03-09T18:24:13.670954+0000","last_undegraded":"2026-03-09T18:24:13.670954+0000","last_fullsized":"2026-03-09T18:24:13.670954+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:47:08.030123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256553+0000","last_change":"2026-03-09T18:24:03.189168+0000","last_active":"2026-03-09T18:24:10.256553+0000","last_peered":"2026-03-09T18:24:10.256553+0000","last_clean":"2026-03-09T18:24:10.256553+0000","last_became_active":"2026-03-09T18:24:03.189036+0000","last_became_peered":"2026-03-09T18:24:03.189036+0000","last_unstale":"2026-03-09T18:24:10.256553+0000","last_undegraded":"2026-03-09T18:24:10.256553+0000","last_fullsized":"2026-03-09T18:24:10.256553+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:16:41.492218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"56'5","reported_seq":33,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605850+0000","last_change":"2026-03-09T18:24:05.199531+0000","last_active":"2026-03-09T18:24:13.605850+0000","last_peered":"2026-03-09T18:24:13.605850+0000","last_clean":"2026-03-09T18:24:13.605850+0000","last_became_active":"2026-03-09T18:24:05.197497+0000","last_became_peered":"2026-03-09T18:24:05.197497+0000","last_unstale":"2026-03-09T18:24:13.605850+0000","last_undegraded":"2026-03-09T18:24:13.605850+0000","last_fullsized":"2026-03-09T18:24:13.605850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:25:35.387567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.246683+0000","last_change":"2026-03-09T18:24:07.225684+0000","last_active":"2026-03-09T18:24:10.246683+0000","last_peered":"2026-03-09T18:24:10.246683+0000","last_clean":"2026-03-09T18:24:10.246683+0000","last_became_active":"2026-03-09T18:24:07.225450+0000","last_became_peered":"2026-03-09T18:24:07.225450+0000","last_unstale":"2026-03-09T18:24:10.246683+0000","last_undegraded":"2026-03-09T18:24:10.246683+0000","last_fullsized":"2026-03-09T18:24:10.246683+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:07:44.609447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256605+0000","last_change":"2026-03-09T18:24:09.237325+0000","last_active":"2026-03-09T18:24:10.256605+0000","last_peered":"2026-03-09T18:24:10.256605+0000","last_clean":"2026-03-09T18:24:10.256605+0000","last_became_active":"2026-03-09T18:24:09.237173+0000","last_became_peered":"2026-03-09T18:24:09.237173+0000","last_unstale":"2026-03-09T18:24:10.256605+0000","last_undegraded":"2026-03-09T18:24:10.256605+0000","last_fullsized":"2026-03-09T18:24:10.256605+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T23:38:21.868434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605955+0000","last_change":"2026-03-09T18:24:09.555175+0000","last_active":"2026-03-09T18:24:13.605955+0000","last_peered":"2026-03-09T18:24:13.605955+0000","last_clean":"2026-03-09T18:24:13.605955+0000","last_became_active":"2026-03-09T18:24:09.555062+0000","last_became_peered":"2026-03-09T18:24:09.555062+0000","last_unstale":"2026-03-09T18:24:13.605955+0000","last_undegraded":"2026-03-09T18:24:13.605955+0000","last_fullsized":"2026-03-09T18:24:13.605955+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T18:55:51.052261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670676+0000","last_change":"2026-03-09T18:24:03.205962+0000","last_active":"2026-03-09T18:24:13.670676+0000","last_peered":"2026-03-09T18:24:13.670676+0000","last_clean":"2026-03-09T18:24:13.670676+0000","last_became_active":"2026-03-09T18:24:03.205812+0000","last_became_peered":"2026-03-09T18:24:03.205812+0000","last_unstale":"2026-03-09T18:24:13.670676+0000","last_undegraded":"2026-03-09T18:24:13.670676+0000","last_fullsized":"2026-03-09T18:24:13.670676+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:43:51.975374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"56'15","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.937471+0000","last_change":"2026-03-09T18:24:05.196657+0000","last_active":"2026-03-09T18:24:10.937471+0000","last_peered":"2026-03-09T18:24:10.937471+0000","last_clean":"2026-03-09T18:24:10.937471+0000","last_became_active":"2026-03-09T18:24:05.196520+0000","last_became_peered":"2026-03-09T18:24:05.196520+0000","last_unstale":"2026-03-09T18:24:10.937471+0000","last_undegraded":"2026-03-09T18:24:10.937471+0000","last_fullsized":"2026-03-09T18:24:10.937471+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T18:39:02.334444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.240324+0000","last_change":"2026-03-09T18:24:07.224678+0000","last_active":"2026-03-09T18:24:10.240324+0000","last_peered":"2026-03-09T18:24:10.240324+0000","last_clean":"2026-03-09T18:24:10.240324+0000","last_became_active":"2026-03-09T18:24:07.224547+0000","last_became_peered":"2026-03-09T18:24:07.224547+0000","last_unstale":"2026-03-09T18:24:10.240324+0000","last_undegraded":"2026-03-09T18:24:10.240324+0000","last_fullsized":"2026-03-09T18:24:10.240324+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:01:37.188001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.231724+0000","last_change":"2026-03-09T18:24:09.558362+0000","last_active":"2026-03-09T18:24:10.231724+0000","last_peered":"2026-03-09T18:24:10.231724+0000","last_clean":"2026-03-09T18:24:10.231724+0000","last_became_active":"2026-03-09T18:24:09.558227+0000","last_became_peered":"2026-03-09T18:24:09.558227+0000","last_unstale":"2026-03-09T18:24:10.231724+0000","last_undegraded":"2026-03-09T18:24:10.231724+0000","last_fullsized":"2026-03-09T18:24:10.231724+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:52:05.264508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605370+0000","last_change":"2026-03-09T18:24:03.190137+0000","last_active":"2026-03-09T18:24:13.605370+0000","last_peered":"2026-03-09T18:24:13.605370+0000","last_clean":"2026-03-09T18:24:13.605370+0000","last_became_active":"2026-03-09T18:24:03.188764+0000","last_became_peered":"2026-03-09T18:24:03.188764+0000","last_unstale":"2026-03-09T18:24:13.605370+0000","last_undegraded":"2026-03-09T18:24:13.605370+0000","last_fullsized":"2026-03-09T18:24:13.605370+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:36:04.720471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"56'12","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:11.062131+0000","last_change":"2026-03-09T18:24:05.220404+0000","last_active":"2026-03-09T18:24:11.062131+0000","last_peered":"2026-03-09T18:24:11.062131+0000","last_clean":"2026-03-09T18:24:11.062131+0000","last_became_active":"2026-03-09T18:24:05.220281+0000","last_became_peered":"2026-03-09T18:24:05.220281+0000","last_unstale":"2026-03-09T18:24:11.062131+0000","last_undegraded":"2026-03-09T18:24:11.062131+0000","last_fullsized":"2026-03-09T18:24:11.062131+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:17:36.536848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605458+0000","last_change":"2026-03-09T18:24:07.230805+0000","last_active":"2026-03-09T18:24:13.605458+0000","last_peered":"2026-03-09T18:24:13.605458+0000","last_clean":"2026-03-09T18:24:13.605458+0000","last_became_active":"2026-03-09T18:24:07.230669+0000","last_became_peered":"2026-03-09T18:24:07.230669+0000","last_unstale":"2026-03-09T18:24:13.605458+0000","last_undegraded":"2026-03-09T18:24:13.605458+0000","last_fullsized":"2026-03-09T18:24:13.605458+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:42:20.095022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.540869+0000","last_change":"2026-03-09T18:24:09.247271+0000","last_active":"2026-03-09T18:24:10.540869+0000","last_peered":"2026-03-09T18:24:10.540869+0000","last_clean":"2026-03-09T18:24:10.540869+0000","last_became_active":"2026-03-09T18:24:09.247083+0000","last_became_peered":"2026-03-09T18:24:09.247083+0000","last_unstale":"2026-03-09T18:24:10.540869+0000","last_undegraded":"2026-03-09T18:24:10.540869+0000","last_fullsized":"2026-03-09T18:24:10.540869+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:59:13.970285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"49'1","reported_seq":26,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.239952+0000","last_change":"2026-03-09T18:24:03.203105+0000","last_active":"2026-03-09T18:24:10.239952+0000","last_peered":"2026-03-09T18:24:10.239952+0000","last_clean":"2026-03-09T18:24:10.239952+0000","last_became_active":"2026-03-09T18:24:03.202671+0000","last_became_peered":"2026-03-09T18:24:03.202671+0000","last_unstale":"2026-03-09T18:24:10.239952+0000","last_undegraded":"2026-03-09T18:24:10.239952+0000","last_fullsized":"2026-03-09T18:24:10.239952+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:22:10.398154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"56'10","reported_seq":38,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671383+0000","last_change":"2026-03-09T18:24:05.699383+0000","last_active":"2026-03-09T18:24:13.671383+0000","last_peered":"2026-03-09T18:24:13.671383+0000","last_clean":"2026-03-09T18:24:13.671383+0000","last_became_active":"2026-03-09T18:24:05.699143+0000","last_became_peered":"2026-03-09T18:24:05.699143+0000","last_unstale":"2026-03-09T18:24:13.671383+0000","last_undegraded":"2026-03-09T18:24:13.671383+0000","last_fullsized":"2026-03-09T18:24:13.671383+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T23:08:07.594817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"56'8","reported_seq":33,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.672925+0000","last_change":"2026-03-09T18:24:07.228890+0000","last_active":"2026-03-09T18:24:13.672925+0000","last_peered":"2026-03-09T18:24:13.672925+0000","last_clean":"2026-03-09T18:24:13.672925+0000","last_became_active":"2026-03-09T18:24:07.228635+0000","last_became_peered":"2026-03-09T18:24:07.228635+0000","last_unstale":"2026-03-09T18:24:13.672925+0000","last_undegraded":"2026-03-09T18:24:13.672925+0000","last_fullsized":"2026-03-09T18:24:13.672925+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:49:37.731144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"56'15","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:11.072998+0000","last_change":"2026-03-09T18:24:05.217400+0000","last_active":"2026-03-09T18:24:11.072998+0000","last_peered":"2026-03-09T18:24:11.072998+0000","last_clean":"2026-03-09T18:24:11.072998+0000","last_became_active":"2026-03-09T18:24:05.214151+0000","last_became_peered":"2026-03-09T18:24:05.214151+0000","last_unstale":"2026-03-09T18:24:11.072998+0000","last_undegraded":"2026-03-09T18:24:11.072998+0000","last_fullsized":"2026-03-09T18:24:11.072998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T02:43:23.643836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222923+0000","last_change":"2026-03-09T18:24:03.206710+0000","last_active":"2026-03-09T18:24:10.222923+0000","last_peered":"2026-03-09T18:24:10.222923+0000","last_clean":"2026-03-09T18:24:10.222923+0000","last_became_active":"2026-03-09T18:24:03.206466+0000","last_became_peered":"2026-03-09T18:24:03.206466+0000","last_unstale":"2026-03-09T18:24:10.222923+0000","last_undegraded":"2026-03-09T18:24:10.222923+0000","last_fullsized":"2026-03-09T18:24:10.222923+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:23:08.492629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"56'8","reported_seq":30,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605292+0000","last_change":"2026-03-09T18:24:07.232460+0000","last_active":"2026-03-09T18:24:13.605292+0000","last_peered":"2026-03-09T18:24:13.605292+0000","last_clean":"2026-03-09T18:24:13.605292+0000","last_became_active":"2026-03-09T18:24:07.232349+0000","last_became_peered":"2026-03-09T18:24:07.232349+0000","last_unstale":"2026-03-09T18:24:13.605292+0000","last_undegraded":"2026-03-09T18:24:13.605292+0000","last_fullsized":"2026-03-09T18:24:13.605292+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:38:06.857831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.257155+0000","last_change":"2026-03-09T18:24:09.230391+0000","last_active":"2026-03-09T18:24:10.257155+0000","last_peered":"2026-03-09T18:24:10.257155+0000","last_clean":"2026-03-09T18:24:10.257155+0000","last_became_active":"2026-03-09T18:24:09.230268+0000","last_became_peered":"2026-03-09T18:24:09.230268+0000","last_unstale":"2026-03-09T18:24:10.257155+0000","last_undegraded":"2026-03-09T18:24:10.257155+0000","last_fullsized":"2026-03-09T18:24:10.257155+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:44:13.269386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"56'18","reported_seq":53,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.970480+0000","last_change":"2026-03-09T18:24:05.700256+0000","last_active":"2026-03-09T18:24:10.970480+0000","last_peered":"2026-03-09T18:24:10.970480+0000","last_clean":"2026-03-09T18:24:10.970480+0000","last_became_active":"2026-03-09T18:24:05.699919+0000","last_became_peered":"2026-03-09T18:24:05.699919+0000","last_unstale":"2026-03-09T18:24:10.970480+0000","last_undegraded":"2026-03-09T18:24:10.970480+0000","last_fullsized":"2026-03-09T18:24:10.970480+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T02:54:44.851870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223094+0000","last_change":"2026-03-09T18:24:03.206451+0000","last_active":"2026-03-09T18:24:10.223094+0000","last_peered":"2026-03-09T18:24:10.223094+0000","last_clean":"2026-03-09T18:24:10.223094+0000","last_became_active":"2026-03-09T18:24:03.206293+0000","last_became_peered":"2026-03-09T18:24:03.206293+0000","last_unstale":"2026-03-09T18:24:10.223094+0000","last_undegraded":"2026-03-09T18:24:10.223094+0000","last_fullsized":"2026-03-09T18:24:10.223094+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:27:50.135544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605168+0000","last_change":"2026-03-09T18:24:07.245499+0000","last_active":"2026-03-09T18:24:13.605168+0000","last_peered":"2026-03-09T18:24:13.605168+0000","last_clean":"2026-03-09T18:24:13.605168+0000","last_became_active":"2026-03-09T18:24:07.245432+0000","last_became_peered":"2026-03-09T18:24:07.245432+0000","last_unstale":"2026-03-09T18:24:13.605168+0000","last_undegraded":"2026-03-09T18:24:13.605168+0000","last_fullsized":"2026-03-09T18:24:13.605168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:39:31.047599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605148+0000","last_change":"2026-03-09T18:24:09.244563+0000","last_active":"2026-03-09T18:24:13.605148+0000","last_peered":"2026-03-09T18:24:13.605148+0000","last_clean":"2026-03-09T18:24:13.605148+0000","last_became_active":"2026-03-09T18:24:09.244307+0000","last_became_peered":"2026-03-09T18:24:09.244307+0000","last_unstale":"2026-03-09T18:24:13.605148+0000","last_undegraded":"2026-03-09T18:24:13.605148+0000","last_fullsized":"2026-03-09T18:24:13.605148+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:05:39.787781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"56'14","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.606117+0000","last_change":"2026-03-09T18:24:05.205488+0000","last_active":"2026-03-09T18:24:13.606117+0000","last_peered":"2026-03-09T18:24:13.606117+0000","last_clean":"2026-03-09T18:24:13.606117+0000","last_became_active":"2026-03-09T18:24:05.205213+0000","last_became_peered":"2026-03-09T18:24:05.205213+0000","last_unstale":"2026-03-09T18:24:13.606117+0000","last_undegraded":"2026-03-09T18:24:13.606117+0000","last_fullsized":"2026-03-09T18:24:13.606117+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:57:29.994246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"49'1","reported_seq":28,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670789+0000","last_change":"2026-03-09T18:24:03.203567+0000","last_active":"2026-03-09T18:24:13.670789+0000","last_peered":"2026-03-09T18:24:13.670789+0000","last_clean":"2026-03-09T18:24:13.670789+0000","last_became_active":"2026-03-09T18:24:03.203478+0000","last_became_peered":"2026-03-09T18:24:03.203478+0000","last_unstale":"2026-03-09T18:24:13.670789+0000","last_undegraded":"2026-03-09T18:24:13.670789+0000","last_fullsized":"2026-03-09T18:24:13.670789+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:32:33.435841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"56'8","reported_seq":28,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.562838+0000","last_change":"2026-03-09T18:24:07.226716+0000","last_active":"2026-03-09T18:24:10.562838+0000","last_peered":"2026-03-09T18:24:10.562838+0000","last_clean":"2026-03-09T18:24:10.562838+0000","last_became_active":"2026-03-09T18:24:07.226628+0000","last_became_peered":"2026-03-09T18:24:07.226628+0000","last_unstale":"2026-03-09T18:24:10.562838+0000","last_undegraded":"2026-03-09T18:24:10.562838+0000","last_fullsized":"2026-03-09T18:24:10.562838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:27:05.340075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.247639+0000","last_change":"2026-03-09T18:24:09.556811+0000","last_active":"2026-03-09T18:24:10.247639+0000","last_peered":"2026-03-09T18:24:10.247639+0000","last_clean":"2026-03-09T18:24:10.247639+0000","last_became_active":"2026-03-09T18:24:09.556583+0000","last_became_peered":"2026-03-09T18:24:09.556583+0000","last_unstale":"2026-03-09T18:24:10.247639+0000","last_undegraded":"2026-03-09T18:24:10.247639+0000","last_fullsized":"2026-03-09T18:24:10.247639+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:10:00.589800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"56'10","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.993904+0000","last_change":"2026-03-09T18:24:05.221086+0000","last_active":"2026-03-09T18:24:10.993904+0000","last_peered":"2026-03-09T18:24:10.993904+0000","last_clean":"2026-03-09T18:24:10.993904+0000","last_became_active":"2026-03-09T18:24:05.214279+0000","last_became_peered":"2026-03-09T18:24:05.214279+0000","last_unstale":"2026-03-09T18:24:10.993904+0000","last_undegraded":"2026-03-09T18:24:10.993904+0000","last_fullsized":"2026-03-09T18:24:10.993904+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T23:45:00.063968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'1","reported_seq":31,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.378636+0000","last_change":"2026-03-09T18:24:03.187794+0000","last_active":"2026-03-09T18:24:10.378636+0000","last_peered":"2026-03-09T18:24:10.378636+0000","last_clean":"2026-03-09T18:24:10.378636+0000","last_became_active":"2026-03-09T18:24:03.187529+0000","last_became_peered":"2026-03-09T18:24:03.187529+0000","last_unstale":"2026-03-09T18:24:10.378636+0000","last_undegraded":"2026-03-09T18:24:10.378636+0000","last_fullsized":"2026-03-09T18:24:10.378636+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:41:31.116897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"56'8","reported_seq":30,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671438+0000","last_change":"2026-03-09T18:24:07.229911+0000","last_active":"2026-03-09T18:24:13.671438+0000","last_peered":"2026-03-09T18:24:13.671438+0000","last_clean":"2026-03-09T18:24:13.671438+0000","last_became_active":"2026-03-09T18:24:07.229310+0000","last_became_peered":"2026-03-09T18:24:07.229310+0000","last_unstale":"2026-03-09T18:24:13.671438+0000","last_undegraded":"2026-03-09T18:24:13.671438+0000","last_fullsized":"2026-03-09T18:24:13.671438+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:00:26.453487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671411+0000","last_change":"2026-03-09T18:24:09.244395+0000","last_active":"2026-03-09T18:24:13.671411+0000","last_peered":"2026-03-09T18:24:13.671411+0000","last_clean":"2026-03-09T18:24:13.671411+0000","last_became_active":"2026-03-09T18:24:09.243975+0000","last_became_peered":"2026-03-09T18:24:09.243975+0000","last_unstale":"2026-03-09T18:24:13.671411+0000","last_undegraded":"2026-03-09T18:24:13.671411+0000","last_fullsized":"2026-03-09T18:24:13.671411+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:10:24.341136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"56'19","reported_seq":59,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671202+0000","last_change":"2026-03-09T18:24:05.698975+0000","last_active":"2026-03-09T18:24:13.671202+0000","last_peered":"2026-03-09T18:24:13.671202+0000","last_clean":"2026-03-09T18:24:13.671202+0000","last_became_active":"2026-03-09T18:24:05.698745+0000","last_became_peered":"2026-03-09T18:24:05.698745+0000","last_unstale":"2026-03-09T18:24:13.671202+0000","last_undegraded":"2026-03-09T18:24:13.671202+0000","last_fullsized":"2026-03-09T18:24:13.671202+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:04:56.091222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.239681+0000","last_change":"2026-03-09T18:24:03.193347+0000","last_active":"2026-03-09T18:24:10.239681+0000","last_peered":"2026-03-09T18:24:10.239681+0000","last_clean":"2026-03-09T18:24:10.239681+0000","last_became_active":"2026-03-09T18:24:03.193185+0000","last_became_peered":"2026-03-09T18:24:03.193185+0000","last_unstale":"2026-03-09T18:24:10.239681+0000","last_undegraded":"2026-03-09T18:24:10.239681+0000","last_fullsized":"2026-03-09T18:24:10.239681+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:03:47.735359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.672899+0000","last_change":"2026-03-09T18:24:07.229777+0000","last_active":"2026-03-09T18:24:13.672899+0000","last_peered":"2026-03-09T18:24:13.672899+0000","last_clean":"2026-03-09T18:24:13.672899+0000","last_became_active":"2026-03-09T18:24:07.229685+0000","last_became_peered":"2026-03-09T18:24:07.229685+0000","last_unstale":"2026-03-09T18:24:13.672899+0000","last_undegraded":"2026-03-09T18:24:13.672899+0000","last_fullsized":"2026-03-09T18:24:13.672899+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:05:26.703210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.239899+0000","last_change":"2026-03-09T18:24:09.554758+0000","last_active":"2026-03-09T18:24:10.239899+0000","last_peered":"2026-03-09T18:24:10.239899+0000","last_clean":"2026-03-09T18:24:10.239899+0000","last_became_active":"2026-03-09T18:24:09.554597+0000","last_became_peered":"2026-03-09T18:24:09.554597+0000","last_unstale":"2026-03-09T18:24:10.239899+0000","last_undegraded":"2026-03-09T18:24:10.239899+0000","last_fullsized":"2026-03-09T18:24:10.239899+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:56:06.407074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"56'28","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.996563+0000","last_change":"2026-03-09T18:24:05.206932+0000","last_active":"2026-03-09T18:24:10.996563+0000","last_peered":"2026-03-09T18:24:10.996563+0000","last_clean":"2026-03-09T18:24:10.996563+0000","last_became_active":"2026-03-09T18:24:05.206535+0000","last_became_peered":"2026-03-09T18:24:05.206535+0000","last_unstale":"2026-03-09T18:24:10.996563+0000","last_undegraded":"2026-03-09T18:24:10.996563+0000","last_fullsized":"2026-03-09T18:24:10.996563+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:53:31.784253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605606+0000","last_change":"2026-03-09T18:24:03.192541+0000","last_active":"2026-03-09T18:24:13.605606+0000","last_peered":"2026-03-09T18:24:13.605606+0000","last_clean":"2026-03-09T18:24:13.605606+0000","last_became_active":"2026-03-09T18:24:03.192399+0000","last_became_peered":"2026-03-09T18:24:03.192399+0000","last_unstale":"2026-03-09T18:24:13.605606+0000","last_undegraded":"2026-03-09T18:24:13.605606+0000","last_fullsized":"2026-03-09T18:24:13.605606+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:59:06.772662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"50'2","reported_seq":34,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256814+0000","last_change":"2026-03-09T18:24:04.189493+0000","last_active":"2026-03-09T18:24:10.256814+0000","last_peered":"2026-03-09T18:24:10.256814+0000","last_clean":"2026-03-09T18:24:10.256814+0000","last_became_active":"2026-03-09T18:24:02.183147+0000","last_became_peered":"2026-03-09T18:24:02.183147+0000","last_unstale":"2026-03-09T18:24:10.256814+0000","last_undegraded":"2026-03-09T18:24:10.256814+0000","last_fullsized":"2026-03-09T18:24:10.256814+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:01.152359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:01.152359+0000","last_clean_scrub_stamp":"2026-03-09T18:24:01.152359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T23:11:58.891905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024143390000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.5","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670634+0000","last_change":"2026-03-09T18:24:07.241423+0000","last_active":"2026-03-09T18:24:13.670634+0000","last_peered":"2026-03-09T18:24:13.670634+0000","last_clean":"2026-03-09T18:24:13.670634+0000","last_became_active":"2026-03-09T18:24:07.241237+0000","last_became_peered":"2026-03-09T18:24:07.241237+0000","last_unstale":"2026-03-09T18:24:13.670634+0000","last_undegraded":"2026-03-09T18:24:13.670634+0000","last_fullsized":"2026-03-09T18:24:13.670634+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:01:50.084248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222844+0000","last_change":"2026-03-09T18:24:09.232007+0000","last_active":"2026-03-09T18:24:10.222844+0000","last_peered":"2026-03-09T18:24:10.222844+0000","last_clean":"2026-03-09T18:24:10.222844+0000","last_became_active":"2026-03-09T18:24:09.231372+0000","last_became_peered":"2026-03-09T18:24:09.231372+0000","last_unstale":"2026-03-09T18:24:10.222844+0000","last_undegraded":"2026-03-09T18:24:10.222844+0000","last_fullsized":"2026-03-09T18:24:10.222844+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:35:38.568069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"56'13","reported_seq":48,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.917888+0000","last_change":"2026-03-09T18:24:05.212698+0000","last_active":"2026-03-09T18:24:10.917888+0000","last_peered":"2026-03-09T18:24:10.917888+0000","last_clean":"2026-03-09T18:24:10.917888+0000","last_became_active":"2026-03-09T18:24:05.209793+0000","last_became_peered":"2026-03-09T18:24:05.209793+0000","last_unstale":"2026-03-09T18:24:10.917888+0000","last_undegraded":"2026-03-09T18:24:10.917888+0000","last_fullsized":"2026-03-09T18:24:10.917888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:19:51.104210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.239712+0000","last_change":"2026-03-09T18:24:03.193297+0000","last_active":"2026-03-09T18:24:10.239712+0000","last_peered":"2026-03-09T18:24:10.239712+0000","last_clean":"2026-03-09T18:24:10.239712+0000","last_became_active":"2026-03-09T18:24:03.193079+0000","last_became_peered":"2026-03-09T18:24:03.193079+0000","last_unstale":"2026-03-09T18:24:10.239712+0000","last_undegraded":"2026-03-09T18:24:10.239712+0000","last_fullsized":"2026-03-09T18:24:10.239712+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:34:47.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"48'1","reported_seq":33,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223891+0000","last_change":"2026-03-09T18:24:04.183349+0000","last_active":"2026-03-09T18:24:10.223891+0000","last_peered":"2026-03-09T18:24:10.223891+0000","last_clean":"2026-03-09T18:24:10.223891+0000","last_became_active":"2026-03-09T18:24:02.183721+0000","last_became_peered":"2026-03-09T18:24:02.183721+0000","last_unstale":"2026-03-09T18:24:10.223891+0000","last_undegraded":"2026-03-09T18:24:10.223891+0000","last_fullsized":"2026-03-09T18:24:10.223891+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:01.152359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:01.152359+0000","last_clean_scrub_stamp":"2026-03-09T18:24:01.152359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:33:46.308541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017623899999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.6","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223951+0000","last_change":"2026-03-09T18:24:07.229394+0000","last_active":"2026-03-09T18:24:10.223951+0000","last_peered":"2026-03-09T18:24:10.223951+0000","last_clean":"2026-03-09T18:24:10.223951+0000","last_became_active":"2026-03-09T18:24:07.227548+0000","last_became_peered":"2026-03-09T18:24:07.227548+0000","last_unstale":"2026-03-09T18:24:10.223951+0000","last_undegraded":"2026-03-09T18:24:10.223951+0000","last_fullsized":"2026-03-09T18:24:10.223951+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:50:47.334701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.246654+0000","last_change":"2026-03-09T18:24:09.557070+0000","last_active":"2026-03-09T18:24:10.246654+0000","last_peered":"2026-03-09T18:24:10.246654+0000","last_clean":"2026-03-09T18:24:10.246654+0000","last_became_active":"2026-03-09T18:24:09.556964+0000","last_became_peered":"2026-03-09T18:24:09.556964+0000","last_unstale":"2026-03-09T18:24:10.246654+0000","last_undegraded":"2026-03-09T18:24:10.246654+0000","last_fullsized":"2026-03-09T18:24:10.246654+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:34:46.948452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"56'12","reported_seq":41,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670877+0000","last_change":"2026-03-09T18:24:05.218664+0000","last_active":"2026-03-09T18:24:13.670877+0000","last_peered":"2026-03-09T18:24:13.670877+0000","last_clean":"2026-03-09T18:24:13.670877+0000","last_became_active":"2026-03-09T18:24:05.218527+0000","last_became_peered":"2026-03-09T18:24:05.218527+0000","last_unstale":"2026-03-09T18:24:13.670877+0000","last_undegraded":"2026-03-09T18:24:13.670877+0000","last_fullsized":"2026-03-09T18:24:13.670877+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T06:15:24.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670851+0000","last_change":"2026-03-09T18:24:03.210263+0000","last_active":"2026-03-09T18:24:13.670851+0000","last_peered":"2026-03-09T18:24:13.670851+0000","last_clean":"2026-03-09T18:24:13.670851+0000","last_became_active":"2026-03-09T18:24:03.210013+0000","last_became_peered":"2026-03-09T18:24:03.210013+0000","last_unstale":"2026-03-09T18:24:13.670851+0000","last_undegraded":"2026-03-09T18:24:13.670851+0000","last_fullsized":"2026-03-09T18:24:13.670851+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:54:25.168399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"56'5","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:12.190315+0000","last_change":"2026-03-09T18:24:04.193958+0000","last_active":"2026-03-09T18:24:12.190315+0000","last_peered":"2026-03-09T18:24:12.190315+0000","last_clean":"2026-03-09T18:24:12.190315+0000","last_became_active":"2026-03-09T18:24:02.190139+0000","last_became_peered":"2026-03-09T18:24:02.190139+0000","last_unstale":"2026-03-09T18:24:12.190315+0000","last_undegraded":"2026-03-09T18:24:12.190315+0000","last_fullsized":"2026-03-09T18:24:12.190315+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:01.152359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:01.152359+0000","last_clean_scrub_stamp":"2026-03-09T18:24:01.152359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:24:46.359307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087120199999999996,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.7","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256632+0000","last_change":"2026-03-09T18:24:07.226949+0000","last_active":"2026-03-09T18:24:10.256632+0000","last_peered":"2026-03-09T18:24:10.256632+0000","last_clean":"2026-03-09T18:24:10.256632+0000","last_became_active":"2026-03-09T18:24:07.226679+0000","last_became_peered":"2026-03-09T18:24:07.226679+0000","last_unstale":"2026-03-09T18:24:10.256632+0000","last_undegraded":"2026-03-09T18:24:10.256632+0000","last_fullsized":"2026-03-09T18:24:10.256632+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:21:55.827439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.239880+0000","last_change":"2026-03-09T18:24:09.224674+0000","last_active":"2026-03-09T18:24:10.239880+0000","last_peered":"2026-03-09T18:24:10.239880+0000","last_clean":"2026-03-09T18:24:10.239880+0000","last_became_active":"2026-03-09T18:24:09.224460+0000","last_became_peered":"2026-03-09T18:24:09.224460+0000","last_unstale":"2026-03-09T18:24:10.239880+0000","last_undegraded":"2026-03-09T18:24:10.239880+0000","last_fullsized":"2026-03-09T18:24:10.239880+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T06:06:17.660160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"56'16","reported_seq":48,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671772+0000","last_change":"2026-03-09T18:24:05.699538+0000","last_active":"2026-03-09T18:24:13.671772+0000","last_peered":"2026-03-09T18:24:13.671772+0000","last_clean":"2026-03-09T18:24:13.671772+0000","last_became_active":"2026-03-09T18:24:05.699038+0000","last_became_peered":"2026-03-09T18:24:05.699038+0000","last_unstale":"2026-03-09T18:24:13.671772+0000","last_undegraded":"2026-03-09T18:24:13.671772+0000","last_fullsized":"2026-03-09T18:24:13.671772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T02:25:16.457417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222983+0000","last_change":"2026-03-09T18:24:03.185064+0000","last_active":"2026-03-09T18:24:10.222983+0000","last_peered":"2026-03-09T18:24:10.222983+0000","last_clean":"2026-03-09T18:24:10.222983+0000","last_became_active":"2026-03-09T18:24:03.184894+0000","last_became_peered":"2026-03-09T18:24:03.184894+0000","last_unstale":"2026-03-09T18:24:10.222983+0000","last_undegraded":"2026-03-09T18:24:10.222983+0000","last_fullsized":"2026-03-09T18:24:10.222983+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:46:02.551821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.247244+0000","last_change":"2026-03-09T18:23:59.124644+0000","last_active":"2026-03-09T18:24:10.247244+0000","last_peered":"2026-03-09T18:24:10.247244+0000","last_clean":"2026-03-09T18:24:10.247244+0000","last_became_active":"2026-03-09T18:23:59.118433+0000","last_became_peered":"2026-03-09T18:23:59.118433+0000","last_unstale":"2026-03-09T18:24:10.247244+0000","last_undegraded":"2026-03-09T18:24:10.247244+0000","last_fullsized":"2026-03-09T18:24:10.247244+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:22:56.440211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:22:56.440211+0000","last_clean_scrub_stamp":"2026-03-09T18:22:56.440211+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:20:32.186367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.247288+0000","last_change":"2026-03-09T18:24:07.239672+0000","last_active":"2026-03-09T18:24:10.247288+0000","last_peered":"2026-03-09T18:24:10.247288+0000","last_clean":"2026-03-09T18:24:10.247288+0000","last_became_active":"2026-03-09T18:24:07.235470+0000","last_became_peered":"2026-03-09T18:24:07.235470+0000","last_unstale":"2026-03-09T18:24:10.247288+0000","last_undegraded":"2026-03-09T18:24:10.247288+0000","last_fullsized":"2026-03-09T18:24:10.247288+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T02:38:37.498887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256471+0000","last_change":"2026-03-09T18:24:09.237425+0000","last_active":"2026-03-09T18:24:10.256471+0000","last_peered":"2026-03-09T18:24:10.256471+0000","last_clean":"2026-03-09T18:24:10.256471+0000","last_became_active":"2026-03-09T18:24:09.237235+0000","last_became_peered":"2026-03-09T18:24:09.237235+0000","last_unstale":"2026-03-09T18:24:10.256471+0000","last_undegraded":"2026-03-09T18:24:10.256471+0000","last_fullsized":"2026-03-09T18:24:10.256471+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T06:22:23.531767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"56'11","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605608+0000","last_change":"2026-03-09T18:24:05.196431+0000","last_active":"2026-03-09T18:24:13.605608+0000","last_peered":"2026-03-09T18:24:13.605608+0000","last_clean":"2026-03-09T18:24:13.605608+0000","last_became_active":"2026-03-09T18:24:05.195745+0000","last_became_peered":"2026-03-09T18:24:05.195745+0000","last_unstale":"2026-03-09T18:24:13.605608+0000","last_undegraded":"2026-03-09T18:24:13.605608+0000","last_fullsized":"2026-03-09T18:24:13.605608+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:20:35.713969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"49'1","reported_seq":33,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605657+0000","last_change":"2026-03-09T18:24:03.205871+0000","last_active":"2026-03-09T18:24:13.605657+0000","last_peered":"2026-03-09T18:24:13.605657+0000","last_clean":"2026-03-09T18:24:13.605657+0000","last_became_active":"2026-03-09T18:24:03.205793+0000","last_became_peered":"2026-03-09T18:24:03.205793+0000","last_unstale":"2026-03-09T18:24:13.605657+0000","last_undegraded":"2026-03-09T18:24:13.605657+0000","last_fullsized":"2026-03-09T18:24:13.605657+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:43:24.997286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256985+0000","last_change":"2026-03-09T18:24:07.241887+0000","last_active":"2026-03-09T18:24:10.256985+0000","last_peered":"2026-03-09T18:24:10.256985+0000","last_clean":"2026-03-09T18:24:10.256985+0000","last_became_active":"2026-03-09T18:24:07.241802+0000","last_became_peered":"2026-03-09T18:24:07.241802+0000","last_unstale":"2026-03-09T18:24:10.256985+0000","last_undegraded":"2026-03-09T18:24:10.256985+0000","last_fullsized":"2026-03-09T18:24:10.256985+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:28:59.012783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222687+0000","last_change":"2026-03-09T18:24:09.557153+0000","last_active":"2026-03-09T18:24:10.222687+0000","last_peered":"2026-03-09T18:24:10.222687+0000","last_clean":"2026-03-09T18:24:10.222687+0000","last_became_active":"2026-03-09T18:24:09.556947+0000","last_became_peered":"2026-03-09T18:24:09.556947+0000","last_unstale":"2026-03-09T18:24:10.222687+0000","last_undegraded":"2026-03-09T18:24:10.222687+0000","last_fullsized":"2026-03-09T18:24:10.222687+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:12:17.883719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"56'17","reported_seq":51,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605918+0000","last_change":"2026-03-09T18:24:05.204761+0000","last_active":"2026-03-09T18:24:13.605918+0000","last_peered":"2026-03-09T18:24:13.605918+0000","last_clean":"2026-03-09T18:24:13.605918+0000","last_became_active":"2026-03-09T18:24:05.200091+0000","last_became_peered":"2026-03-09T18:24:05.200091+0000","last_unstale":"2026-03-09T18:24:13.605918+0000","last_undegraded":"2026-03-09T18:24:13.605918+0000","last_fullsized":"2026-03-09T18:24:13.605918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T18:58:04.679103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.672154+0000","last_change":"2026-03-09T18:24:03.189486+0000","last_active":"2026-03-09T18:24:13.672154+0000","last_peered":"2026-03-09T18:24:13.672154+0000","last_clean":"2026-03-09T18:24:13.672154+0000","last_became_active":"2026-03-09T18:24:03.189408+0000","last_became_peered":"2026-03-09T18:24:03.189408+0000","last_unstale":"2026-03-09T18:24:13.672154+0000","last_undegraded":"2026-03-09T18:24:13.672154+0000","last_fullsized":"2026-03-09T18:24:13.672154+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:35:44.944243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.240106+0000","last_change":"2026-03-09T18:24:07.224576+0000","last_active":"2026-03-09T18:24:10.240106+0000","last_peered":"2026-03-09T18:24:10.240106+0000","last_clean":"2026-03-09T18:24:10.240106+0000","last_became_active":"2026-03-09T18:24:07.224309+0000","last_became_peered":"2026-03-09T18:24:07.224309+0000","last_unstale":"2026-03-09T18:24:10.240106+0000","last_undegraded":"2026-03-09T18:24:10.240106+0000","last_fullsized":"2026-03-09T18:24:10.240106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:32:58.948498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.231460+0000","last_change":"2026-03-09T18:24:09.251790+0000","last_active":"2026-03-09T18:24:10.231460+0000","last_peered":"2026-03-09T18:24:10.231460+0000","last_clean":"2026-03-09T18:24:10.231460+0000","last_became_active":"2026-03-09T18:24:09.251702+0000","last_became_peered":"2026-03-09T18:24:09.251702+0000","last_unstale":"2026-03-09T18:24:10.231460+0000","last_undegraded":"2026-03-09T18:24:10.231460+0000","last_fullsized":"2026-03-09T18:24:10.231460+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T23:22:13.476100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"56'10","reported_seq":38,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605909+0000","last_change":"2026-03-09T18:24:05.200333+0000","last_active":"2026-03-09T18:24:13.605909+0000","last_peered":"2026-03-09T18:24:13.605909+0000","last_clean":"2026-03-09T18:24:13.605909+0000","last_became_active":"2026-03-09T18:24:05.197692+0000","last_became_peered":"2026-03-09T18:24:05.197692+0000","last_unstale":"2026-03-09T18:24:13.605909+0000","last_undegraded":"2026-03-09T18:24:13.605909+0000","last_fullsized":"2026-03-09T18:24:13.605909+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:00:13.706979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222873+0000","last_change":"2026-03-09T18:24:03.199754+0000","last_active":"2026-03-09T18:24:10.222873+0000","last_peered":"2026-03-09T18:24:10.222873+0000","last_clean":"2026-03-09T18:24:10.222873+0000","last_became_active":"2026-03-09T18:24:03.194716+0000","last_became_peered":"2026-03-09T18:24:03.194716+0000","last_unstale":"2026-03-09T18:24:10.222873+0000","last_undegraded":"2026-03-09T18:24:10.222873+0000","last_fullsized":"2026-03-09T18:24:10.222873+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:54:38.755670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"56'8","reported_seq":30,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.569116+0000","last_change":"2026-03-09T18:24:07.227534+0000","last_active":"2026-03-09T18:24:10.569116+0000","last_peered":"2026-03-09T18:24:10.569116+0000","last_clean":"2026-03-09T18:24:10.569116+0000","last_became_active":"2026-03-09T18:24:07.227326+0000","last_became_peered":"2026-03-09T18:24:07.227326+0000","last_unstale":"2026-03-09T18:24:10.569116+0000","last_undegraded":"2026-03-09T18:24:10.569116+0000","last_fullsized":"2026-03-09T18:24:10.569116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T06:10:06.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605738+0000","last_change":"2026-03-09T18:24:09.244636+0000","last_active":"2026-03-09T18:24:13.605738+0000","last_peered":"2026-03-09T18:24:13.605738+0000","last_clean":"2026-03-09T18:24:13.605738+0000","last_became_active":"2026-03-09T18:24:09.244467+0000","last_became_peered":"2026-03-09T18:24:09.244467+0000","last_unstale":"2026-03-09T18:24:13.605738+0000","last_undegraded":"2026-03-09T18:24:13.605738+0000","last_fullsized":"2026-03-09T18:24:13.605738+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:00:42.437702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"56'9","reported_seq":39,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671325+0000","last_change":"2026-03-09T18:24:05.218928+0000","last_active":"2026-03-09T18:24:13.671325+0000","last_peered":"2026-03-09T18:24:13.671325+0000","last_clean":"2026-03-09T18:24:13.671325+0000","last_became_active":"2026-03-09T18:24:05.218827+0000","last_became_peered":"2026-03-09T18:24:05.218827+0000","last_unstale":"2026-03-09T18:24:13.671325+0000","last_undegraded":"2026-03-09T18:24:13.671325+0000","last_fullsized":"2026-03-09T18:24:13.671325+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T18:26:05.594380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256678+0000","last_change":"2026-03-09T18:24:03.201628+0000","last_active":"2026-03-09T18:24:10.256678+0000","last_peered":"2026-03-09T18:24:10.256678+0000","last_clean":"2026-03-09T18:24:10.256678+0000","last_became_active":"2026-03-09T18:24:03.201497+0000","last_became_peered":"2026-03-09T18:24:03.201497+0000","last_unstale":"2026-03-09T18:24:10.256678+0000","last_undegraded":"2026-03-09T18:24:10.256678+0000","last_fullsized":"2026-03-09T18:24:10.256678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:23:55.215925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.227489+0000","last_change":"2026-03-09T18:24:07.224368+0000","last_active":"2026-03-09T18:24:10.227489+0000","last_peered":"2026-03-09T18:24:10.227489+0000","last_clean":"2026-03-09T18:24:10.227489+0000","last_became_active":"2026-03-09T18:24:07.223915+0000","last_became_peered":"2026-03-09T18:24:07.223915+0000","last_unstale":"2026-03-09T18:24:10.227489+0000","last_undegraded":"2026-03-09T18:24:10.227489+0000","last_fullsized":"2026-03-09T18:24:10.227489+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:44:47.759567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671288+0000","last_change":"2026-03-09T18:24:09.244267+0000","last_active":"2026-03-09T18:24:13.671288+0000","last_peered":"2026-03-09T18:24:13.671288+0000","last_clean":"2026-03-09T18:24:13.671288+0000","last_became_active":"2026-03-09T18:24:09.244142+0000","last_became_peered":"2026-03-09T18:24:09.244142+0000","last_unstale":"2026-03-09T18:24:13.671288+0000","last_undegraded":"2026-03-09T18:24:13.671288+0000","last_fullsized":"2026-03-09T18:24:13.671288+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:18:56.112517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"56'19","reported_seq":54,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.672320+0000","last_change":"2026-03-09T18:24:05.699674+0000","last_active":"2026-03-09T18:24:13.672320+0000","last_peered":"2026-03-09T18:24:13.672320+0000","last_clean":"2026-03-09T18:24:13.672320+0000","last_became_active":"2026-03-09T18:24:05.699368+0000","last_became_peered":"2026-03-09T18:24:05.699368+0000","last_unstale":"2026-03-09T18:24:13.672320+0000","last_undegraded":"2026-03-09T18:24:13.672320+0000","last_fullsized":"2026-03-09T18:24:13.672320+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:47:50.243024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.247206+0000","last_change":"2026-03-09T18:24:03.207195+0000","last_active":"2026-03-09T18:24:10.247206+0000","last_peered":"2026-03-09T18:24:10.247206+0000","last_clean":"2026-03-09T18:24:10.247206+0000","last_became_active":"2026-03-09T18:24:03.205891+0000","last_became_peered":"2026-03-09T18:24:03.205891+0000","last_unstale":"2026-03-09T18:24:10.247206+0000","last_undegraded":"2026-03-09T18:24:10.247206+0000","last_fullsized":"2026-03-09T18:24:10.247206+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T23:30:00.371442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.227921+0000","last_change":"2026-03-09T18:24:07.227722+0000","last_active":"2026-03-09T18:24:10.227921+0000","last_peered":"2026-03-09T18:24:10.227921+0000","last_clean":"2026-03-09T18:24:10.227921+0000","last_became_active":"2026-03-09T18:24:07.227564+0000","last_became_peered":"2026-03-09T18:24:07.227564+0000","last_unstale":"2026-03-09T18:24:10.227921+0000","last_undegraded":"2026-03-09T18:24:10.227921+0000","last_fullsized":"2026-03-09T18:24:10.227921+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:39:23.479230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.247192+0000","last_change":"2026-03-09T18:24:09.243922+0000","last_active":"2026-03-09T18:24:10.247192+0000","last_peered":"2026-03-09T18:24:10.247192+0000","last_clean":"2026-03-09T18:24:10.247192+0000","last_became_active":"2026-03-09T18:24:09.243767+0000","last_became_peered":"2026-03-09T18:24:09.243767+0000","last_unstale":"2026-03-09T18:24:10.247192+0000","last_undegraded":"2026-03-09T18:24:10.247192+0000","last_fullsized":"2026-03-09T18:24:10.247192+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:21:20.502452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"56'12","reported_seq":46,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.606260+0000","last_change":"2026-03-09T18:24:05.200969+0000","last_active":"2026-03-09T18:24:13.606260+0000","last_peered":"2026-03-09T18:24:13.606260+0000","last_clean":"2026-03-09T18:24:13.606260+0000","last_became_active":"2026-03-09T18:24:05.197302+0000","last_became_peered":"2026-03-09T18:24:05.197302+0000","last_unstale":"2026-03-09T18:24:13.606260+0000","last_undegraded":"2026-03-09T18:24:13.606260+0000","last_fullsized":"2026-03-09T18:24:13.606260+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:11:31.543493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.247118+0000","last_change":"2026-03-09T18:24:03.207973+0000","last_active":"2026-03-09T18:24:10.247118+0000","last_peered":"2026-03-09T18:24:10.247118+0000","last_clean":"2026-03-09T18:24:10.247118+0000","last_became_active":"2026-03-09T18:24:03.207856+0000","last_became_peered":"2026-03-09T18:24:03.207856+0000","last_unstale":"2026-03-09T18:24:10.247118+0000","last_undegraded":"2026-03-09T18:24:10.247118+0000","last_fullsized":"2026-03-09T18:24:10.247118+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:30:10.752732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.227441+0000","last_change":"2026-03-09T18:24:07.216714+0000","last_active":"2026-03-09T18:24:10.227441+0000","last_peered":"2026-03-09T18:24:10.227441+0000","last_clean":"2026-03-09T18:24:10.227441+0000","last_became_active":"2026-03-09T18:24:07.216610+0000","last_became_peered":"2026-03-09T18:24:07.216610+0000","last_unstale":"2026-03-09T18:24:10.227441+0000","last_undegraded":"2026-03-09T18:24:10.227441+0000","last_fullsized":"2026-03-09T18:24:10.227441+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:39:09.838212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223512+0000","last_change":"2026-03-09T18:24:09.236682+0000","last_active":"2026-03-09T18:24:10.223512+0000","last_peered":"2026-03-09T18:24:10.223512+0000","last_clean":"2026-03-09T18:24:10.223512+0000","last_became_active":"2026-03-09T18:24:09.231385+0000","last_became_peered":"2026-03-09T18:24:09.231385+0000","last_unstale":"2026-03-09T18:24:10.223512+0000","last_undegraded":"2026-03-09T18:24:10.223512+0000","last_fullsized":"2026-03-09T18:24:10.223512+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:18:36.241588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"56'15","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.946529+0000","last_change":"2026-03-09T18:24:05.701723+0000","last_active":"2026-03-09T18:24:10.946529+0000","last_peered":"2026-03-09T18:24:10.946529+0000","last_clean":"2026-03-09T18:24:10.946529+0000","last_became_active":"2026-03-09T18:24:05.701555+0000","last_became_peered":"2026-03-09T18:24:05.701555+0000","last_unstale":"2026-03-09T18:24:10.946529+0000","last_undegraded":"2026-03-09T18:24:10.946529+0000","last_fullsized":"2026-03-09T18:24:10.946529+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:58:05.928460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"49'2","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.426908+0000","last_change":"2026-03-09T18:24:03.207918+0000","last_active":"2026-03-09T18:24:10.426908+0000","last_peered":"2026-03-09T18:24:10.426908+0000","last_clean":"2026-03-09T18:24:10.426908+0000","last_became_active":"2026-03-09T18:24:03.207600+0000","last_became_peered":"2026-03-09T18:24:03.207600+0000","last_unstale":"2026-03-09T18:24:10.426908+0000","last_undegraded":"2026-03-09T18:24:10.426908+0000","last_fullsized":"2026-03-09T18:24:10.426908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:30:09.650183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"56'8","reported_seq":28,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.573472+0000","last_change":"2026-03-09T18:24:07.225626+0000","last_active":"2026-03-09T18:24:10.573472+0000","last_peered":"2026-03-09T18:24:10.573472+0000","last_clean":"2026-03-09T18:24:10.573472+0000","last_became_active":"2026-03-09T18:24:07.225349+0000","last_became_peered":"2026-03-09T18:24:07.225349+0000","last_unstale":"2026-03-09T18:24:10.573472+0000","last_undegraded":"2026-03-09T18:24:10.573472+0000","last_fullsized":"2026-03-09T18:24:10.573472+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:03:40.680785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256472+0000","last_change":"2026-03-09T18:24:09.553776+0000","last_active":"2026-03-09T18:24:10.256472+0000","last_peered":"2026-03-09T18:24:10.256472+0000","last_clean":"2026-03-09T18:24:10.256472+0000","last_became_active":"2026-03-09T18:24:09.553571+0000","last_became_peered":"2026-03-09T18:24:09.553571+0000","last_unstale":"2026-03-09T18:24:10.256472+0000","last_undegraded":"2026-03-09T18:24:10.256472+0000","last_fullsized":"2026-03-09T18:24:10.256472+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T23:56:15.529841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.672140+0000","last_change":"2026-03-09T18:24:03.196586+0000","last_active":"2026-03-09T18:24:13.672140+0000","last_peered":"2026-03-09T18:24:13.672140+0000","last_clean":"2026-03-09T18:24:13.672140+0000","last_became_active":"2026-03-09T18:24:03.196485+0000","last_became_peered":"2026-03-09T18:24:03.196485+0000","last_unstale":"2026-03-09T18:24:13.672140+0000","last_undegraded":"2026-03-09T18:24:13.672140+0000","last_fullsized":"2026-03-09T18:24:13.672140+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:45:22.631661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"56'6","reported_seq":30,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.965727+0000","last_change":"2026-03-09T18:24:05.702342+0000","last_active":"2026-03-09T18:24:10.965727+0000","last_peered":"2026-03-09T18:24:10.965727+0000","last_clean":"2026-03-09T18:24:10.965727+0000","last_became_active":"2026-03-09T18:24:05.702245+0000","last_became_peered":"2026-03-09T18:24:05.702245+0000","last_unstale":"2026-03-09T18:24:10.965727+0000","last_undegraded":"2026-03-09T18:24:10.965727+0000","last_fullsized":"2026-03-09T18:24:10.965727+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:54:23.031427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256718+0000","last_change":"2026-03-09T18:24:07.226870+0000","last_active":"2026-03-09T18:24:10.256718+0000","last_peered":"2026-03-09T18:24:10.256718+0000","last_clean":"2026-03-09T18:24:10.256718+0000","last_became_active":"2026-03-09T18:24:07.226577+0000","last_became_peered":"2026-03-09T18:24:07.226577+0000","last_unstale":"2026-03-09T18:24:10.256718+0000","last_undegraded":"2026-03-09T18:24:10.256718+0000","last_fullsized":"2026-03-09T18:24:10.256718+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:10:12.638292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.247552+0000","last_change":"2026-03-09T18:24:09.556749+0000","last_active":"2026-03-09T18:24:10.247552+0000","last_peered":"2026-03-09T18:24:10.247552+0000","last_clean":"2026-03-09T18:24:10.247552+0000","last_became_active":"2026-03-09T18:24:09.556628+0000","last_became_peered":"2026-03-09T18:24:09.556628+0000","last_unstale":"2026-03-09T18:24:10.247552+0000","last_undegraded":"2026-03-09T18:24:10.247552+0000","last_fullsized":"2026-03-09T18:24:10.247552+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:34:31.350991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"56'9","reported_seq":39,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671355+0000","last_change":"2026-03-09T18:24:05.699196+0000","last_active":"2026-03-09T18:24:13.671355+0000","last_peered":"2026-03-09T18:24:13.671355+0000","last_clean":"2026-03-09T18:24:13.671355+0000","last_became_active":"2026-03-09T18:24:05.698853+0000","last_became_peered":"2026-03-09T18:24:05.698853+0000","last_unstale":"2026-03-09T18:24:13.671355+0000","last_undegraded":"2026-03-09T18:24:13.671355+0000","last_fullsized":"2026-03-09T18:24:13.671355+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:16:23.156092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.246967+0000","last_change":"2026-03-09T18:24:03.207568+0000","last_active":"2026-03-09T18:24:10.246967+0000","last_peered":"2026-03-09T18:24:10.246967+0000","last_clean":"2026-03-09T18:24:10.246967+0000","last_became_active":"2026-03-09T18:24:03.207431+0000","last_became_peered":"2026-03-09T18:24:03.207431+0000","last_unstale":"2026-03-09T18:24:10.246967+0000","last_undegraded":"2026-03-09T18:24:10.246967+0000","last_fullsized":"2026-03-09T18:24:10.246967+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:02:35.434653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222776+0000","last_change":"2026-03-09T18:24:07.217336+0000","last_active":"2026-03-09T18:24:10.222776+0000","last_peered":"2026-03-09T18:24:10.222776+0000","last_clean":"2026-03-09T18:24:10.222776+0000","last_became_active":"2026-03-09T18:24:07.217177+0000","last_became_peered":"2026-03-09T18:24:07.217177+0000","last_unstale":"2026-03-09T18:24:10.222776+0000","last_undegraded":"2026-03-09T18:24:10.222776+0000","last_fullsized":"2026-03-09T18:24:10.222776+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:32:26.680381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222115+0000","last_change":"2026-03-09T18:24:09.243608+0000","last_active":"2026-03-09T18:24:10.222115+0000","last_peered":"2026-03-09T18:24:10.222115+0000","last_clean":"2026-03-09T18:24:10.222115+0000","last_became_active":"2026-03-09T18:24:09.243240+0000","last_became_peered":"2026-03-09T18:24:09.243240+0000","last_unstale":"2026-03-09T18:24:10.222115+0000","last_undegraded":"2026-03-09T18:24:10.222115+0000","last_fullsized":"2026-03-09T18:24:10.222115+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:16:23.304982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"56'9","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.990909+0000","last_change":"2026-03-09T18:24:05.700166+0000","last_active":"2026-03-09T18:24:10.990909+0000","last_peered":"2026-03-09T18:24:10.990909+0000","last_clean":"2026-03-09T18:24:10.990909+0000","last_became_active":"2026-03-09T18:24:05.700039+0000","last_became_peered":"2026-03-09T18:24:05.700039+0000","last_unstale":"2026-03-09T18:24:10.990909+0000","last_undegraded":"2026-03-09T18:24:10.990909+0000","last_fullsized":"2026-03-09T18:24:10.990909+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:23:38.153149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670764+0000","last_change":"2026-03-09T18:24:03.208339+0000","last_active":"2026-03-09T18:24:13.670764+0000","last_peered":"2026-03-09T18:24:13.670764+0000","last_clean":"2026-03-09T18:24:13.670764+0000","last_became_active":"2026-03-09T18:24:03.205829+0000","last_became_peered":"2026-03-09T18:24:03.205829+0000","last_unstale":"2026-03-09T18:24:13.670764+0000","last_undegraded":"2026-03-09T18:24:13.670764+0000","last_fullsized":"2026-03-09T18:24:13.670764+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:31:43.899273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"56'8","reported_seq":28,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.572169+0000","last_change":"2026-03-09T18:24:07.207074+0000","last_active":"2026-03-09T18:24:10.572169+0000","last_peered":"2026-03-09T18:24:10.572169+0000","last_clean":"2026-03-09T18:24:10.572169+0000","last_became_active":"2026-03-09T18:24:07.206931+0000","last_became_peered":"2026-03-09T18:24:07.206931+0000","last_unstale":"2026-03-09T18:24:10.572169+0000","last_undegraded":"2026-03-09T18:24:10.572169+0000","last_fullsized":"2026-03-09T18:24:10.572169+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:39:17.281302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605054+0000","last_change":"2026-03-09T18:24:09.246051+0000","last_active":"2026-03-09T18:24:13.605054+0000","last_peered":"2026-03-09T18:24:13.605054+0000","last_clean":"2026-03-09T18:24:13.605054+0000","last_became_active":"2026-03-09T18:24:09.245653+0000","last_became_peered":"2026-03-09T18:24:09.245653+0000","last_unstale":"2026-03-09T18:24:13.605054+0000","last_undegraded":"2026-03-09T18:24:13.605054+0000","last_fullsized":"2026-03-09T18:24:13.605054+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:14:13.704927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"56'10","reported_seq":36,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.987198+0000","last_change":"2026-03-09T18:24:05.700180+0000","last_active":"2026-03-09T18:24:10.987198+0000","last_peered":"2026-03-09T18:24:10.987198+0000","last_clean":"2026-03-09T18:24:10.987198+0000","last_became_active":"2026-03-09T18:24:05.699788+0000","last_became_peered":"2026-03-09T18:24:05.699788+0000","last_unstale":"2026-03-09T18:24:10.987198+0000","last_undegraded":"2026-03-09T18:24:10.987198+0000","last_fullsized":"2026-03-09T18:24:10.987198+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:05:53.156748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.246895+0000","last_change":"2026-03-09T18:24:03.207760+0000","last_active":"2026-03-09T18:24:10.246895+0000","last_peered":"2026-03-09T18:24:10.246895+0000","last_clean":"2026-03-09T18:24:10.246895+0000","last_became_active":"2026-03-09T18:24:03.207658+0000","last_became_peered":"2026-03-09T18:24:03.207658+0000","last_unstale":"2026-03-09T18:24:10.246895+0000","last_undegraded":"2026-03-09T18:24:10.246895+0000","last_fullsized":"2026-03-09T18:24:10.246895+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:46:54.897444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"56'8","reported_seq":27,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.508766+0000","last_change":"2026-03-09T18:24:07.226804+0000","last_active":"2026-03-09T18:24:10.508766+0000","last_peered":"2026-03-09T18:24:10.508766+0000","last_clean":"2026-03-09T18:24:10.508766+0000","last_became_active":"2026-03-09T18:24:07.226445+0000","last_became_peered":"2026-03-09T18:24:07.226445+0000","last_unstale":"2026-03-09T18:24:10.508766+0000","last_undegraded":"2026-03-09T18:24:10.508766+0000","last_fullsized":"2026-03-09T18:24:10.508766+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:27:00.805131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670462+0000","last_change":"2026-03-09T18:24:09.237903+0000","last_active":"2026-03-09T18:24:13.670462+0000","last_peered":"2026-03-09T18:24:13.670462+0000","last_clean":"2026-03-09T18:24:13.670462+0000","last_became_active":"2026-03-09T18:24:09.237798+0000","last_became_peered":"2026-03-09T18:24:09.237798+0000","last_unstale":"2026-03-09T18:24:13.670462+0000","last_undegraded":"2026-03-09T18:24:13.670462+0000","last_fullsized":"2026-03-09T18:24:13.670462+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T22:40:01.328498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"56'11","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605415+0000","last_change":"2026-03-09T18:24:05.196544+0000","last_active":"2026-03-09T18:24:13.605415+0000","last_peered":"2026-03-09T18:24:13.605415+0000","last_clean":"2026-03-09T18:24:13.605415+0000","last_became_active":"2026-03-09T18:24:05.196078+0000","last_became_peered":"2026-03-09T18:24:05.196078+0000","last_unstale":"2026-03-09T18:24:13.605415+0000","last_undegraded":"2026-03-09T18:24:13.605415+0000","last_fullsized":"2026-03-09T18:24:13.605415+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:56:29.132463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.605391+0000","last_change":"2026-03-09T18:24:03.209595+0000","last_active":"2026-03-09T18:24:13.605391+0000","last_peered":"2026-03-09T18:24:13.605391+0000","last_clean":"2026-03-09T18:24:13.605391+0000","last_became_active":"2026-03-09T18:24:03.209470+0000","last_became_peered":"2026-03-09T18:24:03.209470+0000","last_unstale":"2026-03-09T18:24:13.605391+0000","last_undegraded":"2026-03-09T18:24:13.605391+0000","last_fullsized":"2026-03-09T18:24:13.605391+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:47:06.372658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.240364+0000","last_change":"2026-03-09T18:24:07.232513+0000","last_active":"2026-03-09T18:24:10.240364+0000","last_peered":"2026-03-09T18:24:10.240364+0000","last_clean":"2026-03-09T18:24:10.240364+0000","last_became_active":"2026-03-09T18:24:07.232136+0000","last_became_peered":"2026-03-09T18:24:07.232136+0000","last_unstale":"2026-03-09T18:24:10.240364+0000","last_undegraded":"2026-03-09T18:24:10.240364+0000","last_fullsized":"2026-03-09T18:24:10.240364+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T18:32:44.982164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.543677+0000","last_change":"2026-03-09T18:24:09.231904+0000","last_active":"2026-03-09T18:24:10.543677+0000","last_peered":"2026-03-09T18:24:10.543677+0000","last_clean":"2026-03-09T18:24:10.543677+0000","last_became_active":"2026-03-09T18:24:09.231807+0000","last_became_peered":"2026-03-09T18:24:09.231807+0000","last_unstale":"2026-03-09T18:24:10.543677+0000","last_undegraded":"2026-03-09T18:24:10.543677+0000","last_fullsized":"2026-03-09T18:24:10.543677+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T05:38:53.618664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"56'9","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.840672+0000","last_change":"2026-03-09T18:24:05.221190+0000","last_active":"2026-03-09T18:24:10.840672+0000","last_peered":"2026-03-09T18:24:10.840672+0000","last_clean":"2026-03-09T18:24:10.840672+0000","last_became_active":"2026-03-09T18:24:05.209831+0000","last_became_peered":"2026-03-09T18:24:05.209831+0000","last_unstale":"2026-03-09T18:24:10.840672+0000","last_undegraded":"2026-03-09T18:24:10.840672+0000","last_fullsized":"2026-03-09T18:24:10.840672+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:28:20.138287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.246851+0000","last_change":"2026-03-09T18:24:03.208284+0000","last_active":"2026-03-09T18:24:10.246851+0000","last_peered":"2026-03-09T18:24:10.246851+0000","last_clean":"2026-03-09T18:24:10.246851+0000","last_became_active":"2026-03-09T18:24:03.208172+0000","last_became_peered":"2026-03-09T18:24:03.208172+0000","last_unstale":"2026-03-09T18:24:10.246851+0000","last_undegraded":"2026-03-09T18:24:10.246851+0000","last_fullsized":"2026-03-09T18:24:10.246851+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T18:49:15.426350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223446+0000","last_change":"2026-03-09T18:24:07.220189+0000","last_active":"2026-03-09T18:24:10.223446+0000","last_peered":"2026-03-09T18:24:10.223446+0000","last_clean":"2026-03-09T18:24:10.223446+0000","last_became_active":"2026-03-09T18:24:07.220058+0000","last_became_peered":"2026-03-09T18:24:07.220058+0000","last_unstale":"2026-03-09T18:24:10.223446+0000","last_undegraded":"2026-03-09T18:24:10.223446+0000","last_fullsized":"2026-03-09T18:24:10.223446+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:20:14.532057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670534+0000","last_change":"2026-03-09T18:24:09.238768+0000","last_active":"2026-03-09T18:24:13.670534+0000","last_peered":"2026-03-09T18:24:13.670534+0000","last_clean":"2026-03-09T18:24:13.670534+0000","last_became_active":"2026-03-09T18:24:09.238607+0000","last_became_peered":"2026-03-09T18:24:09.238607+0000","last_unstale":"2026-03-09T18:24:13.670534+0000","last_undegraded":"2026-03-09T18:24:13.670534+0000","last_fullsized":"2026-03-09T18:24:13.670534+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:56:49.887205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"56'11","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:11.044461+0000","last_change":"2026-03-09T18:24:05.700051+0000","last_active":"2026-03-09T18:24:11.044461+0000","last_peered":"2026-03-09T18:24:11.044461+0000","last_clean":"2026-03-09T18:24:11.044461+0000","last_became_active":"2026-03-09T18:24:05.699627+0000","last_became_peered":"2026-03-09T18:24:05.699627+0000","last_unstale":"2026-03-09T18:24:11.044461+0000","last_undegraded":"2026-03-09T18:24:11.044461+0000","last_fullsized":"2026-03-09T18:24:11.044461+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:29:13.226323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.256609+0000","last_change":"2026-03-09T18:24:03.203571+0000","last_active":"2026-03-09T18:24:10.256609+0000","last_peered":"2026-03-09T18:24:10.256609+0000","last_clean":"2026-03-09T18:24:10.256609+0000","last_became_active":"2026-03-09T18:24:03.203466+0000","last_became_peered":"2026-03-09T18:24:03.203466+0000","last_unstale":"2026-03-09T18:24:10.256609+0000","last_undegraded":"2026-03-09T18:24:10.256609+0000","last_fullsized":"2026-03-09T18:24:10.256609+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T06:04:38.142520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.246735+0000","last_change":"2026-03-09T18:24:07.225732+0000","last_active":"2026-03-09T18:24:10.246735+0000","last_peered":"2026-03-09T18:24:10.246735+0000","last_clean":"2026-03-09T18:24:10.246735+0000","last_became_active":"2026-03-09T18:24:07.225544+0000","last_became_peered":"2026-03-09T18:24:07.225544+0000","last_unstale":"2026-03-09T18:24:10.246735+0000","last_undegraded":"2026-03-09T18:24:10.246735+0000","last_fullsized":"2026-03-09T18:24:10.246735+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:00:53.834199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.223560+0000","last_change":"2026-03-09T18:24:09.554047+0000","last_active":"2026-03-09T18:24:10.223560+0000","last_peered":"2026-03-09T18:24:10.223560+0000","last_clean":"2026-03-09T18:24:10.223560+0000","last_became_active":"2026-03-09T18:24:09.553575+0000","last_became_peered":"2026-03-09T18:24:09.553575+0000","last_unstale":"2026-03-09T18:24:10.223560+0000","last_undegraded":"2026-03-09T18:24:10.223560+0000","last_fullsized":"2026-03-09T18:24:10.223560+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T00:30:09.614302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"56'4","reported_seq":27,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.660316+0000","last_change":"2026-03-09T18:24:05.211464+0000","last_active":"2026-03-09T18:24:10.660316+0000","last_peered":"2026-03-09T18:24:10.660316+0000","last_clean":"2026-03-09T18:24:10.660316+0000","last_became_active":"2026-03-09T18:24:05.211104+0000","last_became_peered":"2026-03-09T18:24:05.211104+0000","last_unstale":"2026-03-09T18:24:10.660316+0000","last_undegraded":"2026-03-09T18:24:10.660316+0000","last_fullsized":"2026-03-09T18:24:10.660316+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T04:40:04.637449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.670703+0000","last_change":"2026-03-09T18:24:03.213642+0000","last_active":"2026-03-09T18:24:13.670703+0000","last_peered":"2026-03-09T18:24:13.670703+0000","last_clean":"2026-03-09T18:24:13.670703+0000","last_became_active":"2026-03-09T18:24:03.213408+0000","last_became_peered":"2026-03-09T18:24:03.213408+0000","last_unstale":"2026-03-09T18:24:13.670703+0000","last_undegraded":"2026-03-09T18:24:13.670703+0000","last_fullsized":"2026-03-09T18:24:13.670703+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T19:33:12.351115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.672808+0000","last_change":"2026-03-09T18:24:07.228975+0000","last_active":"2026-03-09T18:24:13.672808+0000","last_peered":"2026-03-09T18:24:13.672808+0000","last_clean":"2026-03-09T18:24:13.672808+0000","last_became_active":"2026-03-09T18:24:07.228789+0000","last_became_peered":"2026-03-09T18:24:07.228789+0000","last_unstale":"2026-03-09T18:24:13.672808+0000","last_undegraded":"2026-03-09T18:24:13.672808+0000","last_fullsized":"2026-03-09T18:24:13.672808+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T06:15:20.634499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.246569+0000","last_change":"2026-03-09T18:24:09.247222+0000","last_active":"2026-03-09T18:24:10.246569+0000","last_peered":"2026-03-09T18:24:10.246569+0000","last_clean":"2026-03-09T18:24:10.246569+0000","last_became_active":"2026-03-09T18:24:09.247123+0000","last_became_peered":"2026-03-09T18:24:09.247123+0000","last_unstale":"2026-03-09T18:24:10.246569+0000","last_undegraded":"2026-03-09T18:24:10.246569+0000","last_fullsized":"2026-03-09T18:24:10.246569+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T20:43:28.329189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.240185+0000","last_change":"2026-03-09T18:24:09.224735+0000","last_active":"2026-03-09T18:24:10.240185+0000","last_peered":"2026-03-09T18:24:10.240185+0000","last_clean":"2026-03-09T18:24:10.240185+0000","last_became_active":"2026-03-09T18:24:09.224602+0000","last_became_peered":"2026-03-09T18:24:09.224602+0000","last_unstale":"2026-03-09T18:24:10.240185+0000","last_undegraded":"2026-03-09T18:24:10.240185+0000","last_fullsized":"2026-03-09T18:24:10.240185+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:08.199093+0000","last_clean_scrub_stamp":"2026-03-09T18:24:08.199093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:06:04.278966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-03-09T18:24:10.222944+0000","last_change":"2026-03-09T18:24:03.201690+0000","last_active":"2026-03-09T18:24:10.222944+0000","last_peered":"2026-03-09T18:24:10.222944+0000","last_clean":"2026-03-09T18:24:10.222944+0000","last_became_active":"2026-03-09T18:24:03.201352+0000","last_became_peered":"2026-03-09T18:24:03.201352+0000","last_unstale":"2026-03-09T18:24:10.222944+0000","last_undegraded":"2026-03-09T18:24:10.222944+0000","last_fullsized":"2026-03-09T18:24:10.222944+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:02.155761+0000","last_clean_scrub_stamp":"2026-03-09T18:24:02.155761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T01:38:59.452823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"56'11","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.672232+0000","last_change":"2026-03-09T18:24:05.214358+0000","last_active":"2026-03-09T18:24:13.672232+0000","last_peered":"2026-03-09T18:24:13.672232+0000","last_clean":"2026-03-09T18:24:13.672232+0000","last_became_active":"2026-03-09T18:24:05.214262+0000","last_became_peered":"2026-03-09T18:24:05.214262+0000","last_unstale":"2026-03-09T18:24:13.672232+0000","last_undegraded":"2026-03-09T18:24:13.672232+0000","last_fullsized":"2026-03-09T18:24:13.672232+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:04.173735+0000","last_clean_scrub_stamp":"2026-03-09T18:24:04.173735+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-10T21:35:32.573607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-03-09T18:24:13.671109+0000","last_change":"2026-03-09T18:24:07.226750+0000","last_active":"2026-03-09T18:24:13.671109+0000","last_peered":"2026-03-09T18:24:13.671109+0000","last_clean":"2026-03-09T18:24:13.671109+0000","last_became_active":"2026-03-09T18:24:07.226658+0000","last_became_peered":"2026-03-09T18:24:07.226658+0000","last_unstale":"2026-03-09T18:24:13.671109+0000","last_undegraded":"2026-03-09T18:24:13.671109+0000","last_fullsized":"2026-03-09T18:24:13.671109+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-03-09T18:24:06.182342+0000","last_clean_scrub_stamp":"2026-03-09T18:24:06.182342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-03-11T03:15:56.846850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":393,"ondisk_log_size":393,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":44,"seq":188978561029,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":28028,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939396,"statfs":{"total":21470642176,"available":21441941504,"internally_reserved":0,"allocated":1224704,"data_stored":846699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1585,"internal_metadata":27457999},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":38,"seq":163208757256,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":28012,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939412,"statfs":{"total":21470642176,"available":21441957888,"internally_reserved":0,"allocated":1200128,"data_stored":845178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27457997},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920778,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27448,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939976,"statfs":{"total":21470642176,"available":21442535424,"internally_reserved":0,"allocated":618496,"data_stored":256175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084301,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27476,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939948,"statfs":{"total":21470642176,"available":21442506752,"internally_reserved":0,"allocated":651264,"data_stored":263207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247823,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27472,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939952,"statfs":{"total":21470642176,"available":21442510848,"internally_reserved":0,"allocated":651264,"data_stored":256707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27457996},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476753,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27428,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939996,"statfs":{"total":21470642176,"available":21442555904,"internally_reserved":0,"allocated":610304,"data_stored":256387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607572,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":27488,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939936,"statfs":{"total":21470642176,"available":21442494464,"internally_reserved":0,"allocated":671744,"data_stored":256595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":20967424,"kb_used":28048,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":26814,"kb_avail":20939376,"statfs":{"total":21470642176,"available":21441921024,"internally_reserved":0,"allocated":1241088,"data_stored":853341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27457994},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":2338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-03-09T18:24:17.487 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-03-09T18:24:17.487 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-03-09T18:24:17.487 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-03-09T18:24:17.487 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph health --format=json 2026-03-09T18:24:17.717 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:18.018 INFO:teuthology.orchestra.run.vm02.stdout: 2026-03-09T18:24:18.019 INFO:teuthology.orchestra.run.vm02.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-03-09T18:24:18.020 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:24:17 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:24:17.997Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..." 2026-03-09T18:24:18.062 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:18 vm02 ceph-mon[56210]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T18:24:18.062 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:18 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:18.062 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:18 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:18.062 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:18 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:18.062 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:18 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2026-03-09T18:24:18.062 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:18 vm02 ceph-mon[50486]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T18:24:18.062 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:18 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:18.062 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:18 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:18.062 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:18 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:18.062 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:18 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2026-03-09T18:24:18.214 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-03-09T18:24:18.214 INFO:tasks.cephadm:Setup complete, yielding 2026-03-09T18:24:18.214 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-03-09T18:24:18.216 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@vm02.local 2026-03-09T18:24:18.217 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- bash -c 'stat -c '"'"'%u %g'"'"' /var/log/ceph | grep '"'"'167 167'"'"'' 2026-03-09T18:24:18.408 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:18.441 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:18 vm03 ceph-mon[54135]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T18:24:18.441 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:18 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:18.441 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:18 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:18.441 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:18 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:18.441 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:18 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2026-03-09T18:24:18.502 INFO:teuthology.orchestra.run.vm02.stdout:167 167 2026-03-09T18:24:18.672 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- bash -c 'ceph orch status' 2026-03-09T18:24:18.856 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:19 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: ignoring --setuser ceph since I am not root 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:19 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: ignoring --setgroup ceph since I am not root 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:19 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:19.183+0000 7f5189f35140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[50486]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[50486]: pgmap v128: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail; 58 KiB/s rd, 4.5 KiB/s wr, 141 op/s 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[50486]: from='client.? 192.168.123.102:0/1701563975' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[50486]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[50486]: mgrmap e16: y(active, since 2m), standbys: x 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[56210]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[56210]: pgmap v128: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail; 58 KiB/s rd, 4.5 KiB/s wr, 141 op/s 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[56210]: from='client.? 192.168.123.102:0/1701563975' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:19.244 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:19.245 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[56210]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-03-09T18:24:19.245 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:19 vm02 ceph-mon[56210]: mgrmap e16: y(active, since 2m), standbys: x 2026-03-09T18:24:19.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:19 vm03 ceph-mon[54135]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-03-09T18:24:19.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:19 vm03 ceph-mon[54135]: pgmap v128: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail; 58 KiB/s rd, 4.5 KiB/s wr, 141 op/s 2026-03-09T18:24:19.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:19 vm03 ceph-mon[54135]: from='client.? 192.168.123.102:0/1701563975' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-03-09T18:24:19.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:19 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:19.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:19 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:19.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:19 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' 2026-03-09T18:24:19.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:19 vm03 ceph-mon[54135]: from='mgr.14150 192.168.123.102:0/734307890' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-03-09T18:24:19.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:19 vm03 ceph-mon[54135]: mgrmap e16: y(active, since 2m), standbys: x 2026-03-09T18:24:19.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:19 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: ignoring --setuser ceph since I am not root 2026-03-09T18:24:19.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:19 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: ignoring --setgroup ceph since I am not root 2026-03-09T18:24:19.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:19 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:19.178+0000 7f2ebafe0140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-03-09T18:24:19.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:19 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:19.234+0000 7f2ebafe0140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T18:24:19.606 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:19 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:19.241+0000 7f5189f35140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-03-09T18:24:20.003 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:19 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:19.714+0000 7f2ebafe0140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T18:24:20.066 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:19 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:19.701+0000 7f5189f35140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-03-09T18:24:20.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:20 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:20.063+0000 7f5189f35140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T18:24:20.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:20 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T18:24:20.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:20 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T18:24:20.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:20 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: from numpy import show_config as show_numpy_config 2026-03-09T18:24:20.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:20 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:20.156+0000 7f5189f35140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T18:24:20.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:20 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:20.196+0000 7f5189f35140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T18:24:20.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:20 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:20.272+0000 7f5189f35140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T18:24:20.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:20 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:20.076+0000 7f2ebafe0140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-03-09T18:24:20.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:20 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-03-09T18:24:20.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:20 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-03-09T18:24:20.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:20 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: from numpy import show_config as show_numpy_config 2026-03-09T18:24:20.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:20 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:20.173+0000 7f2ebafe0140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-03-09T18:24:20.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:20 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:20.212+0000 7f2ebafe0140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-03-09T18:24:20.503 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:20 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:20.293+0000 7f2ebafe0140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-03-09T18:24:21.126 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:20 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:20.872+0000 7f2ebafe0140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T18:24:21.126 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:20 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:20.993+0000 7f2ebafe0140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T18:24:21.126 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:21 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:21.039+0000 7f2ebafe0140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T18:24:21.126 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:21 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:21.078+0000 7f2ebafe0140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T18:24:21.149 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:20 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:20.878+0000 7f5189f35140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-03-09T18:24:21.149 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:21 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:21.014+0000 7f5189f35140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-03-09T18:24:21.149 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:21 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:21.058+0000 7f5189f35140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-03-09T18:24:21.149 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:21 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:21.099+0000 7f5189f35140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-03-09T18:24:21.425 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:21 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:21.124+0000 7f2ebafe0140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T18:24:21.425 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:21 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:21.168+0000 7f2ebafe0140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T18:24:21.425 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:21 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:21.366+0000 7f2ebafe0140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T18:24:21.463 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:21 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:21.147+0000 7f5189f35140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-03-09T18:24:21.463 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:21 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:21.191+0000 7f5189f35140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-03-09T18:24:21.463 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:21 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:21.397+0000 7f5189f35140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-03-09T18:24:21.716 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:21 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:21.460+0000 7f5189f35140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T18:24:21.753 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:21 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:21.422+0000 7f2ebafe0140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-03-09T18:24:21.753 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:21 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:21.663+0000 7f2ebafe0140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T18:24:22.037 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:21 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:21.714+0000 7f5189f35140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-03-09T18:24:22.253 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:21 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:21.973+0000 7f2ebafe0140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T18:24:22.253 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:22 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:22.015+0000 7f2ebafe0140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T18:24:22.253 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:22 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:22.067+0000 7f2ebafe0140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T18:24:22.253 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:22 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:22.166+0000 7f2ebafe0140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T18:24:22.253 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:22 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:22.213+0000 7f2ebafe0140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T18:24:22.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:22 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:22.034+0000 7f5189f35140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-03-09T18:24:22.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:22 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:22.082+0000 7f5189f35140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-03-09T18:24:22.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:22 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:22.132+0000 7f5189f35140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-03-09T18:24:22.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:22 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:22.229+0000 7f5189f35140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-03-09T18:24:22.356 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:22 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:22.273+0000 7f5189f35140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-03-09T18:24:22.598 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:22 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:22.310+0000 7f2ebafe0140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T18:24:22.599 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:22 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:22.440+0000 7f2ebafe0140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T18:24:22.656 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:22 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:22.368+0000 7f5189f35140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-03-09T18:24:22.656 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:22 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:22.495+0000 7f5189f35140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-03-09T18:24:22.855 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:22 vm03 ceph-mon[54135]: Standby manager daemon x restarted 2026-03-09T18:24:22.855 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:22 vm03 ceph-mon[54135]: Standby manager daemon x started 2026-03-09T18:24:22.855 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:22 vm03 ceph-mon[54135]: from='mgr.? 192.168.123.103:0/3855661582' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2026-03-09T18:24:22.855 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:22 vm03 ceph-mon[54135]: from='mgr.? 192.168.123.103:0/3855661582' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-03-09T18:24:22.855 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:22 vm03 ceph-mon[54135]: from='mgr.? 192.168.123.103:0/3855661582' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2026-03-09T18:24:22.855 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:22 vm03 ceph-mon[54135]: from='mgr.? 192.168.123.103:0/3855661582' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-03-09T18:24:22.855 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:22 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:22.596+0000 7f2ebafe0140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T18:24:22.855 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:22 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:22.641+0000 7f2ebafe0140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T18:24:22.855 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:22 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: [09/Mar/2026:18:24:22] ENGINE Bus STARTING 2026-03-09T18:24:22.855 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:22 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: CherryPy Checker: 2026-03-09T18:24:22.855 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:22 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: The Application mounted at '' has an empty config. 2026-03-09T18:24:22.856 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:22 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: 2026-03-09T18:24:22.856 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:22 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: [09/Mar/2026:18:24:22] ENGINE Serving on http://:::9283 2026-03-09T18:24:22.856 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:22 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x[56225]: [09/Mar/2026:18:24:22] ENGINE Bus STARTED 2026-03-09T18:24:22.910 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:22 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:22.654+0000 7f5189f35140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-03-09T18:24:22.910 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:22 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:22.699+0000 7f5189f35140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-03-09T18:24:22.910 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:22 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: [09/Mar/2026:18:24:22] ENGINE Bus STARTING 2026-03-09T18:24:22.910 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:22 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: CherryPy Checker: 2026-03-09T18:24:22.910 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:22 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: The Application mounted at '' has an empty config. 2026-03-09T18:24:22.910 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:22 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: 2026-03-09T18:24:22.910 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:22 vm02 ceph-mon[50486]: Standby manager daemon x restarted 2026-03-09T18:24:22.910 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:22 vm02 ceph-mon[50486]: Standby manager daemon x started 2026-03-09T18:24:22.910 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:22 vm02 ceph-mon[50486]: from='mgr.? 192.168.123.103:0/3855661582' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2026-03-09T18:24:22.910 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:22 vm02 ceph-mon[50486]: from='mgr.? 192.168.123.103:0/3855661582' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-03-09T18:24:22.911 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:22 vm02 ceph-mon[50486]: from='mgr.? 192.168.123.103:0/3855661582' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2026-03-09T18:24:22.911 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:22 vm02 ceph-mon[50486]: from='mgr.? 192.168.123.103:0/3855661582' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-03-09T18:24:22.911 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:22 vm02 ceph-mon[56210]: Standby manager daemon x restarted 2026-03-09T18:24:22.911 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:22 vm02 ceph-mon[56210]: Standby manager daemon x started 2026-03-09T18:24:22.911 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:22 vm02 ceph-mon[56210]: from='mgr.? 192.168.123.103:0/3855661582' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2026-03-09T18:24:22.911 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:22 vm02 ceph-mon[56210]: from='mgr.? 192.168.123.103:0/3855661582' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-03-09T18:24:22.911 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:22 vm02 ceph-mon[56210]: from='mgr.? 192.168.123.103:0/3855661582' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2026-03-09T18:24:22.911 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:22 vm02 ceph-mon[56210]: from='mgr.? 192.168.123.103:0/3855661582' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-03-09T18:24:23.167 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:23 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: [09/Mar/2026:18:24:23] ENGINE Serving on http://:::9283 2026-03-09T18:24:23.167 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:23 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: [09/Mar/2026:18:24:23] ENGINE Bus STARTED 2026-03-09T18:24:24.115 INFO:teuthology.orchestra.run.vm02.stdout:Backend: cephadm 2026-03-09T18:24:24.115 INFO:teuthology.orchestra.run.vm02.stdout:Available: Yes 2026-03-09T18:24:24.115 INFO:teuthology.orchestra.run.vm02.stdout:Paused: No 2026-03-09T18:24:24.297 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- bash -c 'ceph orch ps' 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: Active manager daemon y restarted 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: Activating manager daemon y 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: mgrmap e17: y(active, since 2m), standbys: x 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: osdmap e58: 8 total, 8 up, 8 in 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: mgrmap e18: y(active, starting, since 0.0240647s), standbys: x 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: Manager daemon y is now available 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:24:24.337 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: Updating vm02:/etc/ceph/ceph.conf 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: Active manager daemon y restarted 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: Activating manager daemon y 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: mgrmap e17: y(active, since 2m), standbys: x 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: osdmap e58: 8 total, 8 up, 8 in 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: mgrmap e18: y(active, starting, since 0.0240647s), standbys: x 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: Manager daemon y is now available 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:24.338 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:24:24.339 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:24:24.339 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:24:24.339 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:24:24.339 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:24.339 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:24.339 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: Updating vm02:/etc/ceph/ceph.conf 2026-03-09T18:24:24.339 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T18:24:24.339 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-09T18:24:24.339 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:24:24.339 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:24:24.339 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:24:24.339 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:24 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:24:24.503 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:24:24 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: debug there is no tcmu-runner data available 2026-03-09T18:24:24.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: Active manager daemon y restarted 2026-03-09T18:24:24.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: Activating manager daemon y 2026-03-09T18:24:24.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: mgrmap e17: y(active, since 2m), standbys: x 2026-03-09T18:24:24.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: osdmap e58: 8 total, 8 up, 8 in 2026-03-09T18:24:24.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: mgrmap e18: y(active, starting, since 0.0240647s), standbys: x 2026-03-09T18:24:24.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-03-09T18:24:24.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-03-09T18:24:24.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-03-09T18:24:24.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-03-09T18:24:24.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-03-09T18:24:24.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-03-09T18:24:24.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-03-09T18:24:24.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-03-09T18:24:24.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: Manager daemon y is now available 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm02", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:vm03", "name": "osd_memory_target"}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: Updating vm02:/etc/ceph/ceph.conf 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: Updating vm03:/etc/ceph/ceph.conf 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:24:24.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:24 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2026-03-09T18:24:24.524 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:agent.vm02 vm02 running 21s ago 2m - - 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:agent.vm03 vm03 running 6s ago 2m - - 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:iscsi.iscsi.a vm03 *:5000 running (12s) 6s ago 12s - - 3.9 654f31e6858e bdef783e9e4b 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:mgr.x vm03 *:8443,8765 running (2m) 6s ago 2m - - 19.2.3-678-ge911bdeb 654f31e6858e 2539500ee64d 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:mgr.y vm02 *:9283,8765 running (3m) 21s ago 3m 569M - 19.2.3-678-ge911bdeb 654f31e6858e 0c51deea3849 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:mon.a vm02 running (3m) 21s ago 3m 49.8M 2048M 19.2.3-678-ge911bdeb 654f31e6858e 2109a366691d 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:mon.b vm03 running (2m) 6s ago 2m - 2048M 19.2.3-678-ge911bdeb 654f31e6858e 97810b4a488e 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:mon.c vm02 running (2m) 21s ago 2m 45.0M 2048M 19.2.3-678-ge911bdeb 654f31e6858e 43d0f4c6fcff 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:osd.0 vm02 running (2m) 21s ago 2m 65.1M 4096M 19.2.3-678-ge911bdeb 654f31e6858e 795100f411d5 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:osd.1 vm02 running (108s) 21s ago 108s 44.5M 4096M 19.2.3-678-ge911bdeb 654f31e6858e 84e8d3fc172c 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:osd.2 vm02 running (94s) 21s ago 94s 45.5M 4096M 19.2.3-678-ge911bdeb 654f31e6858e e24ee3c4e062 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:osd.3 vm02 running (82s) 21s ago 82s 59.7M 4096M 19.2.3-678-ge911bdeb 654f31e6858e 27e53bc8bd28 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:osd.4 vm03 running (70s) 6s ago 70s - 4096M 19.2.3-678-ge911bdeb 654f31e6858e 742fc5d6f9a9 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:osd.5 vm03 running (57s) 6s ago 57s - 4096M 19.2.3-678-ge911bdeb 654f31e6858e 162ade38d741 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:osd.6 vm03 running (44s) 6s ago 44s - 4096M 19.2.3-678-ge911bdeb 654f31e6858e d62561d9b74c 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:osd.7 vm03 running (32s) 6s ago 32s - 4096M 19.2.3-678-ge911bdeb 654f31e6858e cc3ac5882f27 2026-03-09T18:24:24.791 INFO:teuthology.orchestra.run.vm02.stdout:rgw.foo.a vm02 *:80 running (23s) 21s ago 23s 18.7M - 19.2.3-678-ge911bdeb 654f31e6858e a99a85552049 2026-03-09T18:24:25.011 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- bash -c 'ceph orch ls' 2026-03-09T18:24:25.274 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: Updating vm02:/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: Updating vm03:/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.client.admin.keyring 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.client.admin.keyring 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='client.24427 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: mgrmap e19: y(active, since 1.3866s), standbys: x 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]: dispatch 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]: dispatch 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: Updating vm02:/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: Updating vm03:/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:24:25.307 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.client.admin.keyring 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.client.admin.keyring 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='client.24427 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: mgrmap e19: y(active, since 1.3866s), standbys: x 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]: dispatch 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:24:25.308 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:25 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]: dispatch 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.conf 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: Updating vm02:/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: Updating vm03:/etc/ceph/ceph.client.admin.keyring 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: Updating vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.client.admin.keyring 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: Updating vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/config/ceph.client.admin.keyring 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='client.24427 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: mgrmap e19: y(active, since 1.3866s), standbys: x 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]: dispatch 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:24:25.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:25 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm03", "caps": []}]: dispatch 2026-03-09T18:24:25.579 INFO:teuthology.orchestra.run.vm02.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-03-09T18:24:25.579 INFO:teuthology.orchestra.run.vm02.stdout:agent 2/2 22s ago 2s * 2026-03-09T18:24:25.579 INFO:teuthology.orchestra.run.vm02.stdout:alertmanager ?:9093,9094 0/1 - 18s vm02=a;count:1 2026-03-09T18:24:25.579 INFO:teuthology.orchestra.run.vm02.stdout:grafana ?:3000 0/1 - 17s vm03=a;count:1 2026-03-09T18:24:25.579 INFO:teuthology.orchestra.run.vm02.stdout:iscsi.datapool ?:5000 1/1 6s ago 20s vm03=iscsi.a;count:1 2026-03-09T18:24:25.579 INFO:teuthology.orchestra.run.vm02.stdout:mgr 2/2 22s ago 2m vm02=y;vm03=x;count:2 2026-03-09T18:24:25.579 INFO:teuthology.orchestra.run.vm02.stdout:mon 3/3 22s ago 2m vm02:192.168.123.102=a;vm02:[v2:192.168.123.102:3301,v1:192.168.123.102:6790]=c;vm03:192.168.123.103=b;count:3 2026-03-09T18:24:25.579 INFO:teuthology.orchestra.run.vm02.stdout:node-exporter ?:9100 0/2 - 19s vm02=a;vm03=b;count:2 2026-03-09T18:24:25.579 INFO:teuthology.orchestra.run.vm02.stdout:osd 8 22s ago - 2026-03-09T18:24:25.579 INFO:teuthology.orchestra.run.vm02.stdout:prometheus ?:9095 0/1 - 20s vm03=a;count:1 2026-03-09T18:24:25.579 INFO:teuthology.orchestra.run.vm02.stdout:rgw.foo.a ?:80 1/1 22s ago 24s vm02=foo.a;count:1 2026-03-09T18:24:25.791 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- bash -c 'ceph orch host ls' 2026-03-09T18:24:26.036 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:26.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[50486]: pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:26.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[50486]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:24:26.356 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[50486]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[50486]: [09/Mar/2026:18:24:24] ENGINE Bus STARTING 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[50486]: [09/Mar/2026:18:24:24] ENGINE Serving on https://192.168.123.102:7151 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[50486]: [09/Mar/2026:18:24:24] ENGINE Client ('192.168.123.102', 51530) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[50486]: [09/Mar/2026:18:24:24] ENGINE Serving on http://192.168.123.102:8765 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[50486]: [09/Mar/2026:18:24:24] ENGINE Bus STARTED 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[50486]: pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[50486]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[50486]: mgrmap e20: y(active, since 2s), standbys: x 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[56210]: pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[56210]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[56210]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[56210]: [09/Mar/2026:18:24:24] ENGINE Bus STARTING 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[56210]: [09/Mar/2026:18:24:24] ENGINE Serving on https://192.168.123.102:7151 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[56210]: [09/Mar/2026:18:24:24] ENGINE Client ('192.168.123.102', 51530) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[56210]: [09/Mar/2026:18:24:24] ENGINE Serving on http://192.168.123.102:8765 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[56210]: [09/Mar/2026:18:24:24] ENGINE Bus STARTED 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[56210]: pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[56210]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:26.357 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:26 vm02 ceph-mon[56210]: mgrmap e20: y(active, since 2s), standbys: x 2026-03-09T18:24:26.371 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:26 vm03 ceph-mon[54135]: pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:26.371 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:26 vm03 ceph-mon[54135]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:24:26.371 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:26 vm03 ceph-mon[54135]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:24:26.371 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:26 vm03 ceph-mon[54135]: [09/Mar/2026:18:24:24] ENGINE Bus STARTING 2026-03-09T18:24:26.371 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:26 vm03 ceph-mon[54135]: [09/Mar/2026:18:24:24] ENGINE Serving on https://192.168.123.102:7151 2026-03-09T18:24:26.371 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:26 vm03 ceph-mon[54135]: [09/Mar/2026:18:24:24] ENGINE Client ('192.168.123.102', 51530) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-03-09T18:24:26.371 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:26 vm03 ceph-mon[54135]: [09/Mar/2026:18:24:24] ENGINE Serving on http://192.168.123.102:8765 2026-03-09T18:24:26.371 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:26 vm03 ceph-mon[54135]: [09/Mar/2026:18:24:24] ENGINE Bus STARTED 2026-03-09T18:24:26.372 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:26 vm03 ceph-mon[54135]: pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:26.372 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:26 vm03 ceph-mon[54135]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:26.372 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:26 vm03 ceph-mon[54135]: mgrmap e20: y(active, since 2s), standbys: x 2026-03-09T18:24:26.406 INFO:teuthology.orchestra.run.vm02.stdout:HOST ADDR LABELS STATUS 2026-03-09T18:24:26.407 INFO:teuthology.orchestra.run.vm02.stdout:vm02 192.168.123.102 2026-03-09T18:24:26.407 INFO:teuthology.orchestra.run.vm02.stdout:vm03 192.168.123.103 2026-03-09T18:24:26.407 INFO:teuthology.orchestra.run.vm02.stdout:2 hosts in cluster 2026-03-09T18:24:26.598 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- bash -c 'ceph orch device ls' 2026-03-09T18:24:26.842 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:27.176 INFO:teuthology.orchestra.run.vm02.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-03-09T18:24:27.176 INFO:teuthology.orchestra.run.vm02.stdout:vm02 /dev/nvme0n1 hdd Linux_931875c217b8806cdaa6 20.0G No 24s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-09T18:24:27.176 INFO:teuthology.orchestra.run.vm02.stdout:vm02 /dev/nvme1n1 hdd Linux_aa05b6f0d3806aaace4a 20.0G No 24s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-09T18:24:27.176 INFO:teuthology.orchestra.run.vm02.stdout:vm02 /dev/nvme2n1 hdd Linux_711b483328ca596a640b 20.0G No 24s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-09T18:24:27.176 INFO:teuthology.orchestra.run.vm02.stdout:vm02 /dev/nvme3n1 hdd Linux_502eb0b94b5b6dc7ca8f 20.0G No 24s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-09T18:24:27.176 INFO:teuthology.orchestra.run.vm02.stdout:vm02 /dev/sr0 hdd QEMU_DVD-ROM_QM00003 366k No 24s ago Has a FileSystem, Insufficient space (<5GB) 2026-03-09T18:24:27.176 INFO:teuthology.orchestra.run.vm02.stdout:vm02 /dev/vda hdd 40.0G No 24s ago Has partitions 2026-03-09T18:24:27.176 INFO:teuthology.orchestra.run.vm02.stdout:vm02 /dev/vdb hdd DWNBRSTVMM02001 20.0G No 24s ago Has a FileSystem 2026-03-09T18:24:27.176 INFO:teuthology.orchestra.run.vm02.stdout:vm02 /dev/vdc hdd DWNBRSTVMM02002 20.0G No 24s ago Has a FileSystem 2026-03-09T18:24:27.177 INFO:teuthology.orchestra.run.vm02.stdout:vm02 /dev/vdd hdd DWNBRSTVMM02003 20.0G No 24s ago Has a FileSystem 2026-03-09T18:24:27.177 INFO:teuthology.orchestra.run.vm02.stdout:vm02 /dev/vde hdd DWNBRSTVMM02004 20.0G No 24s ago Has a FileSystem 2026-03-09T18:24:27.177 INFO:teuthology.orchestra.run.vm02.stdout:vm03 /dev/nvme0n1 hdd Linux_d9cb7421c658ad5a7047 20.0G No 29s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-09T18:24:27.177 INFO:teuthology.orchestra.run.vm02.stdout:vm03 /dev/nvme1n1 hdd Linux_02535782da3622b8e5b4 20.0G No 29s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-09T18:24:27.177 INFO:teuthology.orchestra.run.vm02.stdout:vm03 /dev/nvme2n1 hdd Linux_bfefd7b13708929cb043 20.0G No 29s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-09T18:24:27.177 INFO:teuthology.orchestra.run.vm02.stdout:vm03 /dev/nvme3n1 hdd Linux_61559e2322c0a409c6be 20.0G No 29s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-03-09T18:24:27.177 INFO:teuthology.orchestra.run.vm02.stdout:vm03 /dev/sr0 hdd QEMU_DVD-ROM_QM00003 366k No 29s ago Has a FileSystem, Insufficient space (<5GB) 2026-03-09T18:24:27.177 INFO:teuthology.orchestra.run.vm02.stdout:vm03 /dev/vda hdd 40.0G No 29s ago Has partitions 2026-03-09T18:24:27.177 INFO:teuthology.orchestra.run.vm02.stdout:vm03 /dev/vdb hdd DWNBRSTVMM03001 20.0G No 29s ago Has a FileSystem 2026-03-09T18:24:27.177 INFO:teuthology.orchestra.run.vm02.stdout:vm03 /dev/vdc hdd DWNBRSTVMM03002 20.0G No 29s ago Has a FileSystem 2026-03-09T18:24:27.177 INFO:teuthology.orchestra.run.vm02.stdout:vm03 /dev/vdd hdd DWNBRSTVMM03003 20.0G No 29s ago Has a FileSystem 2026-03-09T18:24:27.177 INFO:teuthology.orchestra.run.vm02.stdout:vm03 /dev/vde hdd DWNBRSTVMM03004 20.0G No 29s ago Has a FileSystem 2026-03-09T18:24:27.185 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:27 vm03 ceph-mon[54135]: from='client.14661 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:27.185 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:27 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:27.185 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:27 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:27.185 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:27 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:27.185 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:27 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:24:27.185 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:27 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:24:27.185 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:27 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:27.185 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:27 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:27.185 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:27 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:27.353 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- bash -c 'ceph orch ls --format yaml' 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[50486]: from='client.14661 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[56210]: from='client.14661 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.vm02", "caps": []}]: dispatch 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:27.388 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:27 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:27.842 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:28.309 INFO:teuthology.orchestra.run.vm02.stdout:service_type: agent 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:service_name: agent 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:placement: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: host_pattern: '*' 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:status: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: created: '2026-03-09T18:24:22.779068Z' 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: last_refresh: '2026-03-09T18:24:03.372973Z' 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: running: 2 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: size: 2 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:events: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:- 2026-03-09T18:24:24.201903Z service:agent [INFO] "service was created" 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:--- 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:service_type: alertmanager 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:service_name: alertmanager 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:placement: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: count: 1 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: hosts: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: - vm02=a 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:status: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: created: '2026-03-09T18:24:06.976573Z' 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: ports: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: - 9093 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: - 9094 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: running: 0 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: size: 1 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:--- 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:service_type: grafana 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:service_name: grafana 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:placement: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: count: 1 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: hosts: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: - vm03=a 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:spec: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: anonymous_access: true 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: protocol: https 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:status: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: created: '2026-03-09T18:24:07.608594Z' 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: ports: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: - 3000 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: running: 0 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: size: 1 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:--- 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:service_type: iscsi 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:service_id: datapool 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:service_name: iscsi.datapool 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:placement: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: count: 1 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: hosts: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: - vm03=iscsi.a 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout:spec: 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: api_password: admin 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: api_port: 5000 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: api_user: admin 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: pool: datapool 2026-03-09T18:24:28.310 INFO:teuthology.orchestra.run.vm02.stdout: trusted_ip_list: 192.168.123.103 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:status: 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: created: '2026-03-09T18:24:04.799856Z' 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: last_refresh: '2026-03-09T18:24:28.257752Z' 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: ports: 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: - 5000 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: running: 1 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: size: 1 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:--- 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:service_type: mgr 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:service_name: mgr 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:placement: 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: count: 2 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: hosts: 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: - vm02=y 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: - vm03=x 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:status: 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: created: '2026-03-09T18:22:11.441021Z' 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: last_refresh: '2026-03-09T18:24:03.372950Z' 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: running: 2 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: size: 2 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:--- 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:service_type: mon 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:service_name: mon 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:placement: 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: count: 3 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: hosts: 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: - vm02:192.168.123.102=a 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: - vm02:[v2:192.168.123.102:3301,v1:192.168.123.102:6790]=c 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: - vm03:192.168.123.103=b 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:status: 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: created: '2026-03-09T18:21:56.956742Z' 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: last_refresh: '2026-03-09T18:24:03.372891Z' 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: running: 3 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: size: 3 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:--- 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:service_type: node-exporter 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:service_name: node-exporter 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:placement: 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: count: 2 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: hosts: 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: - vm02=a 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: - vm03=b 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:status: 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: created: '2026-03-09T18:24:06.293679Z' 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: ports: 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: - 9100 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: running: 0 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: size: 2 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:--- 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:service_type: osd 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:service_name: osd 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:unmanaged: true 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:spec: 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: filter_logic: AND 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: objectstore: bluestore 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout:status: 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: container_image_id: 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c 2026-03-09T18:24:28.311 INFO:teuthology.orchestra.run.vm02.stdout: container_image_name: quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: last_refresh: '2026-03-09T18:24:03.373051Z' 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: running: 8 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: size: 8 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout:--- 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout:service_type: prometheus 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout:service_name: prometheus 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout:placement: 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: count: 1 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: hosts: 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: - vm03=a 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout:status: 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: created: '2026-03-09T18:24:05.573044Z' 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: last_refresh: '2026-03-09T18:24:28.257782Z' 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: ports: 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: - 9095 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: running: 1 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: size: 1 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout:--- 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout:service_type: rgw 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout:service_id: foo.a 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout:service_name: rgw.foo.a 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout:placement: 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: count: 1 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: hosts: 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: - vm02=foo.a 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout:status: 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: created: '2026-03-09T18:24:01.269271Z' 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: last_refresh: '2026-03-09T18:24:03.373174Z' 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: ports: 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: - 80 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: running: 1 2026-03-09T18:24:28.312 INFO:teuthology.orchestra.run.vm02.stdout: size: 1 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[50486]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[50486]: from='client.24538 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[50486]: pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[50486]: mgrmap e21: y(active, since 5s), standbys: x 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[56210]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[56210]: from='client.24538 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[56210]: pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[56210]: mgrmap e21: y(active, since 5s), standbys: x 2026-03-09T18:24:28.312 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.313 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.313 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:28 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.377 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:28 vm03 ceph-mon[54135]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:24:28.377 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:28 vm03 ceph-mon[54135]: from='client.24538 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:28.377 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:28 vm03 ceph-mon[54135]: pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:28.377 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:28 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.377 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:28 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.377 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:28 vm03 ceph-mon[54135]: mgrmap e21: y(active, since 5s), standbys: x 2026-03-09T18:24:28.377 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:28 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.377 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:28 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.377 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:28 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:28.564 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- bash -c 'ceph orch ls | grep '"'"'^osd '"'"'' 2026-03-09T18:24:29.079 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "yaml"}]: dispatch 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[50486]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "yaml"}]: dispatch 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:29.427 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:29 vm02 ceph-mon[56210]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.503 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "yaml"}]: dispatch 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: from='mgr.14625 192.168.123.102:0/888096781' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: Metadata not up to date on all hosts. Skipping non agent specs 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 216 MiB used, 160 GiB / 160 GiB avail 2026-03-09T18:24:29.504 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:29 vm03 ceph-mon[54135]: from='mgr.14625 ' entity='mgr.y' 2026-03-09T18:24:29.522 INFO:teuthology.orchestra.run.vm02.stdout:osd 8 26s ago - 2026-03-09T18:24:29.683 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-03-09T18:24:29.686 INFO:tasks.cephadm:Teardown begin 2026-03-09T18:24:29.686 DEBUG:teuthology.orchestra.run.vm02:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-03-09T18:24:29.747 DEBUG:teuthology.orchestra.run.vm03:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-03-09T18:24:29.780 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-03-09T18:24:29.780 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a3515824-1be4-11f1-b292-f5e4728bca3d -- ceph mgr module disable cephadm 2026-03-09T18:24:30.102 INFO:teuthology.orchestra.run.vm02.stderr:Inferring config /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/mon.a/config 2026-03-09T18:24:30.146 INFO:teuthology.orchestra.run.vm02.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-03-09T18:24:30.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-03-09T18:24:30.206 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-03-09T18:24:30.206 DEBUG:teuthology.orchestra.run.vm02:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-03-09T18:24:30.236 DEBUG:teuthology.orchestra.run.vm03:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-03-09T18:24:30.257 INFO:tasks.cephadm:Stopping all daemons... 2026-03-09T18:24:30.257 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-03-09T18:24:30.257 DEBUG:teuthology.orchestra.run.vm02:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mon.a 2026-03-09T18:24:30.535 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:30 vm02 systemd[1]: Stopping Ceph mon.a for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:24:30.535 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:30 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-a[50463]: 2026-03-09T18:24:30.448+0000 7f2e883e5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T18:24:30.535 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:30 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-a[50463]: 2026-03-09T18:24:30.448+0000 7f2e883e5640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-03-09T18:24:30.788 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:30 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: ::ffff:192.168.123.103 - - [09/Mar/2026:18:24:30] "GET /metrics HTTP/1.1" 503 1621 "" "Prometheus/2.51.0" 2026-03-09T18:24:30.788 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:30 vm02 podman[81414]: 2026-03-09 18:24:30.602265499 +0000 UTC m=+0.176170930 container died 2109a366691d0a7294577d88d1725c1a9a96e9309eed7a4e5288b3ce9f76bdc4 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-a, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, io.buildah.version=1.41.3, CEPH_REF=squid, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0) 2026-03-09T18:24:30.788 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:30 vm02 podman[81414]: 2026-03-09 18:24:30.7284966 +0000 UTC m=+0.302402030 container remove 2109a366691d0a7294577d88d1725c1a9a96e9309eed7a4e5288b3ce9f76bdc4 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-a, org.label-schema.schema-version=1.0, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team ) 2026-03-09T18:24:30.788 INFO:journalctl@ceph.mon.a.vm02.stdout:Mar 09 18:24:30 vm02 bash[81414]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-a 2026-03-09T18:24:30.852 DEBUG:teuthology.orchestra.run.vm02:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mon.a.service' 2026-03-09T18:24:30.911 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:24:30.911 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-03-09T18:24:30.912 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2026-03-09T18:24:30.912 DEBUG:teuthology.orchestra.run.vm02:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mon.c 2026-03-09T18:24:31.100 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:30 vm02 systemd[1]: Stopping Ceph mon.c for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:24:31.355 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: [09/Mar/2026:18:24:31] ENGINE Bus STOPPING 2026-03-09T18:24:31.355 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: [09/Mar/2026:18:24:31] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-03-09T18:24:31.355 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: [09/Mar/2026:18:24:31] ENGINE Bus STOPPED 2026-03-09T18:24:31.355 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: [09/Mar/2026:18:24:31] ENGINE Bus STARTING 2026-03-09T18:24:31.355 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: [09/Mar/2026:18:24:31] ENGINE Serving on http://:::9283 2026-03-09T18:24:31.355 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y[50718]: [09/Mar/2026:18:24:31] ENGINE Bus STARTED 2026-03-09T18:24:31.355 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-c[56185]: 2026-03-09T18:24:31.096+0000 7f2a2a7be640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T18:24:31.355 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:31 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-c[56185]: 2026-03-09T18:24:31.096+0000 7f2a2a7be640 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2026-03-09T18:24:31.355 INFO:journalctl@ceph.mon.c.vm02.stdout:Mar 09 18:24:31 vm02 podman[81673]: 2026-03-09 18:24:31.219201957 +0000 UTC m=+0.146507235 container died 43d0f4c6fcffab7f7d284e5fec7ec8169338c33fa080ba12658b43dece1b9e42 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-c, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, ceph=True, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-03-09T18:24:31.448 DEBUG:teuthology.orchestra.run.vm02:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mon.c.service' 2026-03-09T18:24:31.488 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:24:31.489 INFO:tasks.cephadm.mon.b:Stopped mon.c 2026-03-09T18:24:31.489 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2026-03-09T18:24:31.489 DEBUG:teuthology.orchestra.run.vm03:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mon.b 2026-03-09T18:24:31.815 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:31 vm03 systemd[1]: Stopping Ceph mon.b for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:24:31.815 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:31 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-b[54109]: 2026-03-09T18:24:31.613+0000 7f9026ae6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T18:24:31.815 INFO:journalctl@ceph.mon.b.vm03.stdout:Mar 09 18:24:31 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mon-b[54109]: 2026-03-09T18:24:31.613+0000 7f9026ae6640 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2026-03-09T18:24:32.008 DEBUG:teuthology.orchestra.run.vm03:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mon.b.service' 2026-03-09T18:24:32.057 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:24:32.057 INFO:tasks.cephadm.mon.b:Stopped mon.b 2026-03-09T18:24:32.057 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2026-03-09T18:24:32.057 DEBUG:teuthology.orchestra.run.vm02:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mgr.y 2026-03-09T18:24:32.347 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:32 vm02 systemd[1]: Stopping Ceph mgr.y for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:24:32.347 INFO:journalctl@ceph.mgr.y.vm02.stdout:Mar 09 18:24:32 vm02 podman[81828]: 2026-03-09 18:24:32.22552935 +0000 UTC m=+0.075123669 container died 0c51deea3849834b26195441352f2dc712d5d2522a8e7b1b75813ce569585dd5 (image=quay.ceph.io/ceph-ci/ceph:e911bdebe5c8faa3800735d1568fcdca65db60df, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-y, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df) 2026-03-09T18:24:32.434 DEBUG:teuthology.orchestra.run.vm02:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mgr.y.service' 2026-03-09T18:24:32.466 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:24:32.466 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2026-03-09T18:24:32.466 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-03-09T18:24:32.466 DEBUG:teuthology.orchestra.run.vm03:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mgr.x 2026-03-09T18:24:32.751 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:32 vm03 systemd[1]: Stopping Ceph mgr.x for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:24:32.751 INFO:journalctl@ceph.mgr.x.vm03.stdout:Mar 09 18:24:32 vm03 podman[76496]: 2026-03-09 18:24:32.632871847 +0000 UTC m=+0.067094005 container died 2539500ee64d85dd098fc5d398ef3e449995e1e0fe33eabd39d0fce274a568d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-mgr-x, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, org.label-schema.schema-version=1.0, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3) 2026-03-09T18:24:32.835 DEBUG:teuthology.orchestra.run.vm03:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@mgr.x.service' 2026-03-09T18:24:32.872 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:24:32.872 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-03-09T18:24:32.872 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-03-09T18:24:32.872 DEBUG:teuthology.orchestra.run.vm02:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.0 2026-03-09T18:24:33.357 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:24:32 vm02 systemd[1]: Stopping Ceph osd.0 for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:24:33.357 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:24:32 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-0[60651]: 2026-03-09T18:24:32.981+0000 7f2e34f81640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T18:24:33.357 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:24:32 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-0[60651]: 2026-03-09T18:24:32.981+0000 7f2e34f81640 -1 osd.0 58 *** Got signal Terminated *** 2026-03-09T18:24:33.357 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:24:32 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-0[60651]: 2026-03-09T18:24:32.981+0000 7f2e34f81640 -1 osd.0 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-03-09T18:24:38.289 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:24:38 vm02 podman[81964]: 2026-03-09 18:24:38.018575279 +0000 UTC m=+5.055483544 container died 795100f411d55283db2f58074da90826a43993f438e16161d7942a32493950fa (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-0, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.license=GPLv2, ceph=True, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3) 2026-03-09T18:24:38.550 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:24:38 vm02 podman[81964]: 2026-03-09 18:24:38.29859099 +0000 UTC m=+5.335499255 container remove 795100f411d55283db2f58074da90826a43993f438e16161d7942a32493950fa (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, ceph=True, CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-03-09T18:24:38.550 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:24:38 vm02 bash[81964]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-0 2026-03-09T18:24:38.550 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:24:38 vm02 podman[82040]: 2026-03-09 18:24:38.459014396 +0000 UTC m=+0.021477591 container create f3bc2110c9e457781bdab66a0afe7de1296c5dcbd5432a8492033c2bdb7a5857 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-0-deactivate, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=squid, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True) 2026-03-09T18:24:38.550 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:24:38 vm02 podman[82040]: 2026-03-09 18:24:38.512223569 +0000 UTC m=+0.074686772 container init f3bc2110c9e457781bdab66a0afe7de1296c5dcbd5432a8492033c2bdb7a5857 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-0-deactivate, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=squid, org.label-schema.build-date=20260223, OSD_FLAVOR=default, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-03-09T18:24:38.550 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:24:38 vm02 podman[82040]: 2026-03-09 18:24:38.523366514 +0000 UTC m=+0.085829708 container start f3bc2110c9e457781bdab66a0afe7de1296c5dcbd5432a8492033c2bdb7a5857 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-0-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.license=GPLv2, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_REF=squid, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0) 2026-03-09T18:24:38.550 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:24:38 vm02 podman[82040]: 2026-03-09 18:24:38.530558746 +0000 UTC m=+0.093021940 container attach f3bc2110c9e457781bdab66a0afe7de1296c5dcbd5432a8492033c2bdb7a5857 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-0-deactivate, CEPH_REF=squid, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, OSD_FLAVOR=default, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-03-09T18:24:38.801 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:24:38 vm02 podman[82040]: 2026-03-09 18:24:38.450641585 +0000 UTC m=+0.013104779 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T18:24:38.801 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:24:38 vm02 podman[82040]: 2026-03-09 18:24:38.67599484 +0000 UTC m=+0.238458035 container died f3bc2110c9e457781bdab66a0afe7de1296c5dcbd5432a8492033c2bdb7a5857 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=squid) 2026-03-09T18:24:38.801 INFO:journalctl@ceph.osd.0.vm02.stdout:Mar 09 18:24:38 vm02 podman[82040]: 2026-03-09 18:24:38.79735892 +0000 UTC m=+0.359822103 container remove f3bc2110c9e457781bdab66a0afe7de1296c5dcbd5432a8492033c2bdb7a5857 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-0-deactivate, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df) 2026-03-09T18:24:38.811 DEBUG:teuthology.orchestra.run.vm02:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.0.service' 2026-03-09T18:24:38.847 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:24:38.848 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-03-09T18:24:38.848 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-03-09T18:24:38.848 DEBUG:teuthology.orchestra.run.vm02:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.1 2026-03-09T18:24:39.106 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:24:38 vm02 systemd[1]: Stopping Ceph osd.1 for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:24:39.107 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:24:39 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-1[64282]: 2026-03-09T18:24:39.003+0000 7fa729fe4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T18:24:39.107 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:24:39 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-1[64282]: 2026-03-09T18:24:39.003+0000 7fa729fe4640 -1 osd.1 58 *** Got signal Terminated *** 2026-03-09T18:24:39.107 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:24:39 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-1[64282]: 2026-03-09T18:24:39.003+0000 7fa729fe4640 -1 osd.1 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-03-09T18:24:44.339 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:24:44 vm02 podman[82160]: 2026-03-09 18:24:44.031602786 +0000 UTC m=+5.045515794 container died 84e8d3fc172c88a5d50ce33dd9a95e399a83bd67b7b46ba932699cb044ce577c (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-1, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_REF=squid, org.label-schema.license=GPLv2) 2026-03-09T18:24:44.340 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:24:44 vm02 podman[82160]: 2026-03-09 18:24:44.171163944 +0000 UTC m=+5.185076942 container remove 84e8d3fc172c88a5d50ce33dd9a95e399a83bd67b7b46ba932699cb044ce577c (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-1, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, CEPH_REF=squid, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-03-09T18:24:44.340 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:24:44 vm02 bash[82160]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-1 2026-03-09T18:24:44.606 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:24:44 vm02 podman[82240]: 2026-03-09 18:24:44.337470241 +0000 UTC m=+0.016475528 container create d42c4a38f12c95161c5ef4efa38ef93bf48ff4562a00bb50d72fa0f3c172f001 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-1-deactivate, CEPH_REF=squid, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-03-09T18:24:44.607 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:24:44 vm02 podman[82240]: 2026-03-09 18:24:44.387765649 +0000 UTC m=+0.066770957 container init d42c4a38f12c95161c5ef4efa38ef93bf48ff4562a00bb50d72fa0f3c172f001 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-1-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=squid, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2026-03-09T18:24:44.607 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:24:44 vm02 podman[82240]: 2026-03-09 18:24:44.391414699 +0000 UTC m=+0.070419996 container start d42c4a38f12c95161c5ef4efa38ef93bf48ff4562a00bb50d72fa0f3c172f001 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-1-deactivate, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=squid, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team ) 2026-03-09T18:24:44.607 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:24:44 vm02 podman[82240]: 2026-03-09 18:24:44.393746033 +0000 UTC m=+0.072751320 container attach d42c4a38f12c95161c5ef4efa38ef93bf48ff4562a00bb50d72fa0f3c172f001 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_REF=squid, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default) 2026-03-09T18:24:44.607 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:24:44 vm02 podman[82240]: 2026-03-09 18:24:44.330714737 +0000 UTC m=+0.009720043 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T18:24:44.607 INFO:journalctl@ceph.osd.1.vm02.stdout:Mar 09 18:24:44 vm02 podman[82279]: 2026-03-09 18:24:44.555802416 +0000 UTC m=+0.014014853 container died d42c4a38f12c95161c5ef4efa38ef93bf48ff4562a00bb50d72fa0f3c172f001 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_REF=squid) 2026-03-09T18:24:44.690 DEBUG:teuthology.orchestra.run.vm02:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.1.service' 2026-03-09T18:24:44.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:24:44.723 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-03-09T18:24:44.723 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-03-09T18:24:44.723 DEBUG:teuthology.orchestra.run.vm02:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.2 2026-03-09T18:24:45.106 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:24:44 vm02 systemd[1]: Stopping Ceph osd.2 for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:24:45.106 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:24:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-2[68015]: 2026-03-09T18:24:44.882+0000 7fae7e9ed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T18:24:45.106 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:24:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-2[68015]: 2026-03-09T18:24:44.882+0000 7fae7e9ed640 -1 osd.2 58 *** Got signal Terminated *** 2026-03-09T18:24:45.106 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:24:44 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-2[68015]: 2026-03-09T18:24:44.882+0000 7fae7e9ed640 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-03-09T18:24:50.215 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:24:49 vm02 podman[82361]: 2026-03-09 18:24:49.907730795 +0000 UTC m=+5.041806913 container died e24ee3c4e0627e923bdab07d553452b41570df49f8725e5c14c5baf96a1ef69d (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-2, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=squid, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df) 2026-03-09T18:24:50.216 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:24:50 vm02 podman[82361]: 2026-03-09 18:24:50.044137358 +0000 UTC m=+5.178213476 container remove e24ee3c4e0627e923bdab07d553452b41570df49f8725e5c14c5baf96a1ef69d (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-2, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=squid, io.buildah.version=1.41.3, ceph=True, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default) 2026-03-09T18:24:50.216 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:24:50 vm02 bash[82361]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-2 2026-03-09T18:24:50.469 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:24:50 vm02 podman[82440]: 2026-03-09 18:24:50.213970978 +0000 UTC m=+0.020883799 container create 8a979225b73dc7d0568e940d37a19d3761652df955e59c9b1b19a6c60b65a284 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-2-deactivate, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, ceph=True, CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-03-09T18:24:50.469 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:24:50 vm02 podman[82440]: 2026-03-09 18:24:50.25213523 +0000 UTC m=+0.059048051 container init 8a979225b73dc7d0568e940d37a19d3761652df955e59c9b1b19a6c60b65a284 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, CEPH_REF=squid, OSD_FLAVOR=default) 2026-03-09T18:24:50.469 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:24:50 vm02 podman[82440]: 2026-03-09 18:24:50.259084978 +0000 UTC m=+0.065997799 container start 8a979225b73dc7d0568e940d37a19d3761652df955e59c9b1b19a6c60b65a284 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-2-deactivate, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_REF=squid, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0) 2026-03-09T18:24:50.469 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:24:50 vm02 podman[82440]: 2026-03-09 18:24:50.260290595 +0000 UTC m=+0.067203426 container attach 8a979225b73dc7d0568e940d37a19d3761652df955e59c9b1b19a6c60b65a284 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-2-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0) 2026-03-09T18:24:50.469 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:24:50 vm02 podman[82440]: 2026-03-09 18:24:50.206195324 +0000 UTC m=+0.013108156 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T18:24:50.469 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:24:50 vm02 conmon[82452]: conmon 8a979225b73dc7d0568e : Failed to open cgroups file: /sys/fs/cgroup/machine.slice/libpod-8a979225b73dc7d0568e940d37a19d3761652df955e59c9b1b19a6c60b65a284.scope/memory.events 2026-03-09T18:24:50.469 INFO:journalctl@ceph.osd.2.vm02.stdout:Mar 09 18:24:50 vm02 podman[82440]: 2026-03-09 18:24:50.395974526 +0000 UTC m=+0.202887347 container died 8a979225b73dc7d0568e940d37a19d3761652df955e59c9b1b19a6c60b65a284 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, CEPH_REF=squid, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.build-date=20260223, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team ) 2026-03-09T18:24:50.556 DEBUG:teuthology.orchestra.run.vm02:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.2.service' 2026-03-09T18:24:50.591 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:24:50.591 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-03-09T18:24:50.591 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-03-09T18:24:50.591 DEBUG:teuthology.orchestra.run.vm02:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.3 2026-03-09T18:24:50.781 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:24:50 vm02 systemd[1]: Stopping Ceph osd.3 for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:24:51.106 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:24:50 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-3[71313]: 2026-03-09T18:24:50.806+0000 7f3606a3d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T18:24:51.106 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:24:50 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-3[71313]: 2026-03-09T18:24:50.806+0000 7f3606a3d640 -1 osd.3 58 *** Got signal Terminated *** 2026-03-09T18:24:51.106 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:24:50 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-3[71313]: 2026-03-09T18:24:50.806+0000 7f3606a3d640 -1 osd.3 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-03-09T18:24:56.106 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:24:55 vm02 podman[82651]: 2026-03-09 18:24:55.849158918 +0000 UTC m=+5.072911382 container died 27e53bc8bd288590048b4df7d40bc5a76a83d9617e1b10e535494b517ebc5b3a (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-3, CEPH_REF=squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.build-date=20260223, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0) 2026-03-09T18:24:56.107 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:24:55 vm02 podman[82651]: 2026-03-09 18:24:55.972692797 +0000 UTC m=+5.196445271 container remove 27e53bc8bd288590048b4df7d40bc5a76a83d9617e1b10e535494b517ebc5b3a (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-3, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, CEPH_REF=squid, ceph=True) 2026-03-09T18:24:56.107 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:24:55 vm02 bash[82651]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-3 2026-03-09T18:24:56.449 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:24:56 vm02 podman[83095]: 2026-03-09 18:24:56.138248039 +0000 UTC m=+0.018992921 container create 791fab596d544f4e126ab339975c8809901c76aa3a0913fc2482b2629a7c2116 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-3-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_REF=squid, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-03-09T18:24:56.449 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:24:56 vm02 podman[83095]: 2026-03-09 18:24:56.180832735 +0000 UTC m=+0.061577617 container init 791fab596d544f4e126ab339975c8809901c76aa3a0913fc2482b2629a7c2116 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-3-deactivate, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=squid, ceph=True, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df) 2026-03-09T18:24:56.449 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:24:56 vm02 podman[83095]: 2026-03-09 18:24:56.186398783 +0000 UTC m=+0.067143665 container start 791fab596d544f4e126ab339975c8809901c76aa3a0913fc2482b2629a7c2116 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-3-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, ceph=True, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, CEPH_REF=squid) 2026-03-09T18:24:56.449 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:24:56 vm02 podman[83095]: 2026-03-09 18:24:56.188075631 +0000 UTC m=+0.068820524 container attach 791fab596d544f4e126ab339975c8809901c76aa3a0913fc2482b2629a7c2116 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-3-deactivate, org.label-schema.build-date=20260223, CEPH_REF=squid, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, ceph=True, OSD_FLAVOR=default) 2026-03-09T18:24:56.449 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:24:56 vm02 podman[83095]: 2026-03-09 18:24:56.13118041 +0000 UTC m=+0.011925292 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T18:24:56.449 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:24:56 vm02 conmon[83107]: conmon 791fab596d544f4e126a : Failed to open cgroups file: /sys/fs/cgroup/machine.slice/libpod-791fab596d544f4e126ab339975c8809901c76aa3a0913fc2482b2629a7c2116.scope/memory.events 2026-03-09T18:24:56.449 INFO:journalctl@ceph.osd.3.vm02.stdout:Mar 09 18:24:56 vm02 podman[83095]: 2026-03-09 18:24:56.327415034 +0000 UTC m=+0.208159916 container died 791fab596d544f4e126ab339975c8809901c76aa3a0913fc2482b2629a7c2116 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-3-deactivate, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3) 2026-03-09T18:24:56.468 DEBUG:teuthology.orchestra.run.vm02:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.3.service' 2026-03-09T18:24:56.506 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:24:56.506 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-03-09T18:24:56.506 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-03-09T18:24:56.506 DEBUG:teuthology.orchestra.run.vm03:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.4 2026-03-09T18:24:57.003 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:24:56 vm03 systemd[1]: Stopping Ceph osd.4 for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:24:57.003 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:24:56 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-4[60326]: 2026-03-09T18:24:56.623+0000 7fb227536640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T18:24:57.003 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:24:56 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-4[60326]: 2026-03-09T18:24:56.623+0000 7fb227536640 -1 osd.4 58 *** Got signal Terminated *** 2026-03-09T18:24:57.003 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:24:56 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-4[60326]: 2026-03-09T18:24:56.623+0000 7fb227536640 -1 osd.4 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-03-09T18:24:58.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:24:58 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:24:58.273+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:24:59.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:24:59 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:24:59.321+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:00.286 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:00 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:00.020+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.319868+0000 front 2026-03-09T18:24:35.319939+0000 (oldest deadline 2026-03-09T18:24:59.419708+0000) 2026-03-09T18:25:00.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:00 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:00.284+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:01.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:01 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:01.000+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.319868+0000 front 2026-03-09T18:24:35.319939+0000 (oldest deadline 2026-03-09T18:24:59.419708+0000) 2026-03-09T18:25:01.657 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:01 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:01.330+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:01.941 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:01 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5[63950]: 2026-03-09T18:25:01.886+0000 7fa9f93c9640 -1 osd.5 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.797697+0000 front 2026-03-09T18:24:35.797745+0000 (oldest deadline 2026-03-09T18:25:01.697066+0000) 2026-03-09T18:25:01.941 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:25:01 vm03 podman[77140]: 2026-03-09 18:25:01.655922656 +0000 UTC m=+5.052322776 container died 742fc5d6f9a99f5b5a6cdc850a590a894576981931e00b5861a1fada63ceb992 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-4, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, ceph=True, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=squid, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-03-09T18:25:02.205 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:01 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:01.979+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.319868+0000 front 2026-03-09T18:24:35.319939+0000 (oldest deadline 2026-03-09T18:24:59.419708+0000) 2026-03-09T18:25:02.205 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:25:01 vm03 podman[77140]: 2026-03-09 18:25:01.939736761 +0000 UTC m=+5.336136881 container remove 742fc5d6f9a99f5b5a6cdc850a590a894576981931e00b5861a1fada63ceb992 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-4, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_REF=squid, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-03-09T18:25:02.205 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:25:01 vm03 bash[77140]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-4 2026-03-09T18:25:02.205 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:25:02 vm03 podman[77219]: 2026-03-09 18:25:02.111423431 +0000 UTC m=+0.020440211 container create cd0d7719bdb958adc80fc0773b746ee2e55cf5c01ce535dd47ebc7e2357ef66d (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-4-deactivate, CEPH_REF=squid, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df) 2026-03-09T18:25:02.205 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:25:02 vm03 podman[77219]: 2026-03-09 18:25:02.150451085 +0000 UTC m=+0.059467875 container init cd0d7719bdb958adc80fc0773b746ee2e55cf5c01ce535dd47ebc7e2357ef66d (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-4-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=squid) 2026-03-09T18:25:02.205 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:25:02 vm03 podman[77219]: 2026-03-09 18:25:02.155465101 +0000 UTC m=+0.064481881 container start cd0d7719bdb958adc80fc0773b746ee2e55cf5c01ce535dd47ebc7e2357ef66d (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-4-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, CEPH_REF=squid, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-03-09T18:25:02.205 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:25:02 vm03 podman[77219]: 2026-03-09 18:25:02.156851685 +0000 UTC m=+0.065868465 container attach cd0d7719bdb958adc80fc0773b746ee2e55cf5c01ce535dd47ebc7e2357ef66d (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_REF=squid, ceph=True, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-03-09T18:25:02.456 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:02 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:02.322+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:02.456 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:25:02 vm03 podman[77219]: 2026-03-09 18:25:02.104604077 +0000 UTC m=+0.013620857 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T18:25:02.456 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:25:02 vm03 conmon[77230]: conmon cd0d7719bdb958adc80f : Failed to open cgroups file: /sys/fs/cgroup/machine.slice/libpod-cd0d7719bdb958adc80fc0773b746ee2e55cf5c01ce535dd47ebc7e2357ef66d.scope/memory.events 2026-03-09T18:25:02.457 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:25:02 vm03 podman[77219]: 2026-03-09 18:25:02.298414989 +0000 UTC m=+0.207431770 container died cd0d7719bdb958adc80fc0773b746ee2e55cf5c01ce535dd47ebc7e2357ef66d (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-4-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, ceph=True, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0) 2026-03-09T18:25:02.457 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:25:02 vm03 podman[77219]: 2026-03-09 18:25:02.440336084 +0000 UTC m=+0.349352854 container remove cd0d7719bdb958adc80fc0773b746ee2e55cf5c01ce535dd47ebc7e2357ef66d (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-4-deactivate, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, CEPH_REF=squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-03-09T18:25:02.457 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:25:02 vm03 systemd[1]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.4.service: Deactivated successfully. 2026-03-09T18:25:02.457 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:25:02 vm03 systemd[1]: Stopped Ceph osd.4 for a3515824-1be4-11f1-b292-f5e4728bca3d. 2026-03-09T18:25:02.457 INFO:journalctl@ceph.osd.4.vm03.stdout:Mar 09 18:25:02 vm03 systemd[1]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.4.service: Consumed 1.869s CPU time. 2026-03-09T18:25:02.458 DEBUG:teuthology.orchestra.run.vm03:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.4.service' 2026-03-09T18:25:02.500 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:25:02.500 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-03-09T18:25:02.500 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-03-09T18:25:02.500 DEBUG:teuthology.orchestra.run.vm03:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.5 2026-03-09T18:25:02.753 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:02 vm03 systemd[1]: Stopping Ceph osd.5 for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:25:02.753 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:02 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5[63950]: 2026-03-09T18:25:02.651+0000 7fa9fcdb0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T18:25:02.753 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:02 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5[63950]: 2026-03-09T18:25:02.651+0000 7fa9fcdb0640 -1 osd.5 58 *** Got signal Terminated *** 2026-03-09T18:25:02.753 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:02 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5[63950]: 2026-03-09T18:25:02.651+0000 7fa9fcdb0640 -1 osd.5 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-03-09T18:25:03.253 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:02 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5[63950]: 2026-03-09T18:25:02.920+0000 7fa9f93c9640 -1 osd.5 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.797697+0000 front 2026-03-09T18:24:35.797745+0000 (oldest deadline 2026-03-09T18:25:01.697066+0000) 2026-03-09T18:25:03.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:02 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:02.967+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.319868+0000 front 2026-03-09T18:24:35.319939+0000 (oldest deadline 2026-03-09T18:24:59.419708+0000) 2026-03-09T18:25:03.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:03 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:03.319+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:04.253 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:03 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5[63950]: 2026-03-09T18:25:03.913+0000 7fa9f93c9640 -1 osd.5 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.797697+0000 front 2026-03-09T18:24:35.797745+0000 (oldest deadline 2026-03-09T18:25:01.697066+0000) 2026-03-09T18:25:04.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:03 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:03.950+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.319868+0000 front 2026-03-09T18:24:35.319939+0000 (oldest deadline 2026-03-09T18:24:59.419708+0000) 2026-03-09T18:25:04.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:04 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:04.309+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:05.253 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:04 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5[63950]: 2026-03-09T18:25:04.913+0000 7fa9f93c9640 -1 osd.5 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.797697+0000 front 2026-03-09T18:24:35.797745+0000 (oldest deadline 2026-03-09T18:25:01.697066+0000) 2026-03-09T18:25:05.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:04 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:04.999+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.319868+0000 front 2026-03-09T18:24:35.319939+0000 (oldest deadline 2026-03-09T18:24:59.419708+0000) 2026-03-09T18:25:05.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:04 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:04.999+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:39.420329+0000 front 2026-03-09T18:24:39.420502+0000 (oldest deadline 2026-03-09T18:25:04.119952+0000) 2026-03-09T18:25:05.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:05 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:05.322+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:06.253 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:05 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5[63950]: 2026-03-09T18:25:05.934+0000 7fa9f93c9640 -1 osd.5 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.797697+0000 front 2026-03-09T18:24:35.797745+0000 (oldest deadline 2026-03-09T18:25:01.697066+0000) 2026-03-09T18:25:06.253 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:05 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5[63950]: 2026-03-09T18:25:05.934+0000 7fa9f93c9640 -1 osd.5 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.398001+0000 front 2026-03-09T18:24:43.397733+0000 (oldest deadline 2026-03-09T18:25:05.097589+0000) 2026-03-09T18:25:06.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:06 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:06.017+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.319868+0000 front 2026-03-09T18:24:35.319939+0000 (oldest deadline 2026-03-09T18:24:59.419708+0000) 2026-03-09T18:25:06.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:06 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:06.017+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:39.420329+0000 front 2026-03-09T18:24:39.420502+0000 (oldest deadline 2026-03-09T18:25:04.119952+0000) 2026-03-09T18:25:06.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:06 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:06.274+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:07.253 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:06 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5[63950]: 2026-03-09T18:25:06.979+0000 7fa9f93c9640 -1 osd.5 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.797697+0000 front 2026-03-09T18:24:35.797745+0000 (oldest deadline 2026-03-09T18:25:01.697066+0000) 2026-03-09T18:25:07.253 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:06 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5[63950]: 2026-03-09T18:25:06.979+0000 7fa9f93c9640 -1 osd.5 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.398001+0000 front 2026-03-09T18:24:43.397733+0000 (oldest deadline 2026-03-09T18:25:05.097589+0000) 2026-03-09T18:25:07.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:07 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:07.043+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.319868+0000 front 2026-03-09T18:24:35.319939+0000 (oldest deadline 2026-03-09T18:24:59.419708+0000) 2026-03-09T18:25:07.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:07 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:07.043+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:39.420329+0000 front 2026-03-09T18:24:39.420502+0000 (oldest deadline 2026-03-09T18:25:04.119952+0000) 2026-03-09T18:25:07.564 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:07 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:07.303+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:07.565 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:07 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:07.303+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.526791+0000 front 2026-03-09T18:24:43.526472+0000 (oldest deadline 2026-03-09T18:25:06.426377+0000) 2026-03-09T18:25:07.819 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:07 vm03 podman[77339]: 2026-03-09 18:25:07.685289868 +0000 UTC m=+5.049266087 container died 162ade38d74182189541115172cd2292cabcc96d97c7b81a3143760d551d2ef2 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_REF=squid, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-03-09T18:25:07.820 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:07 vm03 podman[77339]: 2026-03-09 18:25:07.8184648 +0000 UTC m=+5.182441010 container remove 162ade38d74182189541115172cd2292cabcc96d97c7b81a3143760d551d2ef2 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, CEPH_REF=squid, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-03-09T18:25:08.082 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:07 vm03 bash[77339]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5 2026-03-09T18:25:08.082 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:07 vm03 podman[77546]: 2026-03-09 18:25:07.989459707 +0000 UTC m=+0.021350256 container create 1513379fc88e17d20f9e510850dc6da7ed835d79041c1c6dac650e1bbdad7ebc (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-03-09T18:25:08.082 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:08 vm03 podman[77546]: 2026-03-09 18:25:08.020506331 +0000 UTC m=+0.052396890 container init 1513379fc88e17d20f9e510850dc6da7ed835d79041c1c6dac650e1bbdad7ebc (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5-deactivate, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, OSD_FLAVOR=default, CEPH_REF=squid, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-03-09T18:25:08.082 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:08 vm03 podman[77546]: 2026-03-09 18:25:08.027157059 +0000 UTC m=+0.059047608 container start 1513379fc88e17d20f9e510850dc6da7ed835d79041c1c6dac650e1bbdad7ebc (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5-deactivate, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default) 2026-03-09T18:25:08.082 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:08 vm03 podman[77546]: 2026-03-09 18:25:08.028384528 +0000 UTC m=+0.060275087 container attach 1513379fc88e17d20f9e510850dc6da7ed835d79041c1c6dac650e1bbdad7ebc (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5-deactivate, org.label-schema.schema-version=1.0, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=squid, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3) 2026-03-09T18:25:08.082 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:08 vm03 podman[77546]: 2026-03-09 18:25:07.982383812 +0000 UTC m=+0.014274371 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T18:25:08.082 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:08 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:08.007+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.319868+0000 front 2026-03-09T18:24:35.319939+0000 (oldest deadline 2026-03-09T18:24:59.419708+0000) 2026-03-09T18:25:08.082 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:08 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:08.007+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:39.420329+0000 front 2026-03-09T18:24:39.420502+0000 (oldest deadline 2026-03-09T18:25:04.119952+0000) 2026-03-09T18:25:08.318 DEBUG:teuthology.orchestra.run.vm03:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.5.service' 2026-03-09T18:25:08.347 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:08 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:08.344+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:08.347 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:08 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:08.344+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.526791+0000 front 2026-03-09T18:24:43.526472+0000 (oldest deadline 2026-03-09T18:25:06.426377+0000) 2026-03-09T18:25:08.347 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:08 vm03 podman[77546]: 2026-03-09 18:25:08.177315804 +0000 UTC m=+0.209206342 container died 1513379fc88e17d20f9e510850dc6da7ed835d79041c1c6dac650e1bbdad7ebc (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5-deactivate, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, CEPH_REF=squid, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, io.buildah.version=1.41.3) 2026-03-09T18:25:08.347 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:08 vm03 podman[77546]: 2026-03-09 18:25:08.299294097 +0000 UTC m=+0.331184646 container remove 1513379fc88e17d20f9e510850dc6da7ed835d79041c1c6dac650e1bbdad7ebc (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=squid, OSD_FLAVOR=default) 2026-03-09T18:25:08.347 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:08 vm03 systemd[1]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.5.service: Deactivated successfully. 2026-03-09T18:25:08.347 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:08 vm03 systemd[1]: Stopped Ceph osd.5 for a3515824-1be4-11f1-b292-f5e4728bca3d. 2026-03-09T18:25:08.347 INFO:journalctl@ceph.osd.5.vm03.stdout:Mar 09 18:25:08 vm03 systemd[1]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.5.service: Consumed 1.394s CPU time. 2026-03-09T18:25:08.372 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:25:08.372 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-03-09T18:25:08.372 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-03-09T18:25:08.372 DEBUG:teuthology.orchestra.run.vm03:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.6 2026-03-09T18:25:08.753 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:08 vm03 systemd[1]: Stopping Ceph osd.6 for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:25:08.753 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:08 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:08.535+0000 7f09445fa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T18:25:08.753 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:08 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:08.535+0000 7f09445fa640 -1 osd.6 58 *** Got signal Terminated *** 2026-03-09T18:25:08.753 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:08 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:08.535+0000 7f09445fa640 -1 osd.6 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-03-09T18:25:09.309 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:09 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:09.004+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.319868+0000 front 2026-03-09T18:24:35.319939+0000 (oldest deadline 2026-03-09T18:24:59.419708+0000) 2026-03-09T18:25:09.310 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:09 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:09.004+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:39.420329+0000 front 2026-03-09T18:24:39.420502+0000 (oldest deadline 2026-03-09T18:25:04.119952+0000) 2026-03-09T18:25:09.754 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:09 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:09.379+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:09.754 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:09 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:09.379+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.526791+0000 front 2026-03-09T18:24:43.526472+0000 (oldest deadline 2026-03-09T18:25:06.426377+0000) 2026-03-09T18:25:10.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:09 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:09.965+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.319868+0000 front 2026-03-09T18:24:35.319939+0000 (oldest deadline 2026-03-09T18:24:59.419708+0000) 2026-03-09T18:25:10.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:09 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:09.965+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:39.420329+0000 front 2026-03-09T18:24:39.420502+0000 (oldest deadline 2026-03-09T18:25:04.119952+0000) 2026-03-09T18:25:10.588 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:10 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:10.420+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:10.588 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:10 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:10.420+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.526791+0000 front 2026-03-09T18:24:43.526472+0000 (oldest deadline 2026-03-09T18:25:06.426377+0000) 2026-03-09T18:25:11.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:10 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:10.931+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.319868+0000 front 2026-03-09T18:24:35.319939+0000 (oldest deadline 2026-03-09T18:24:59.419708+0000) 2026-03-09T18:25:11.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:10 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:10.931+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:39.420329+0000 front 2026-03-09T18:24:39.420502+0000 (oldest deadline 2026-03-09T18:25:04.119952+0000) 2026-03-09T18:25:11.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:10 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:10.931+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6822 osd.2 since back 2026-03-09T18:24:45.820882+0000 front 2026-03-09T18:24:45.820559+0000 (oldest deadline 2026-03-09T18:25:10.520415+0000) 2026-03-09T18:25:11.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:11 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:11.431+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:11.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:11 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:11.431+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.526791+0000 front 2026-03-09T18:24:43.526472+0000 (oldest deadline 2026-03-09T18:25:06.426377+0000) 2026-03-09T18:25:12.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:11 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:11.957+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.319868+0000 front 2026-03-09T18:24:35.319939+0000 (oldest deadline 2026-03-09T18:24:59.419708+0000) 2026-03-09T18:25:12.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:11 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:11.957+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:39.420329+0000 front 2026-03-09T18:24:39.420502+0000 (oldest deadline 2026-03-09T18:25:04.119952+0000) 2026-03-09T18:25:12.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:11 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:11.957+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6822 osd.2 since back 2026-03-09T18:24:45.820882+0000 front 2026-03-09T18:24:45.820559+0000 (oldest deadline 2026-03-09T18:25:10.520415+0000) 2026-03-09T18:25:12.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:12.474+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:12.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:12.474+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.526791+0000 front 2026-03-09T18:24:43.526472+0000 (oldest deadline 2026-03-09T18:25:06.426377+0000) 2026-03-09T18:25:13.253 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:12.982+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:35.319868+0000 front 2026-03-09T18:24:35.319939+0000 (oldest deadline 2026-03-09T18:24:59.419708+0000) 2026-03-09T18:25:13.266 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:12.982+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:39.420329+0000 front 2026-03-09T18:24:39.420502+0000 (oldest deadline 2026-03-09T18:25:04.119952+0000) 2026-03-09T18:25:13.266 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:12 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6[67575]: 2026-03-09T18:25:12.982+0000 7f0940c13640 -1 osd.6 58 heartbeat_check: no reply from 192.168.123.102:6822 osd.2 since back 2026-03-09T18:24:45.820882+0000 front 2026-03-09T18:24:45.820559+0000 (oldest deadline 2026-03-09T18:25:10.520415+0000) 2026-03-09T18:25:13.753 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:13 vm03 podman[77664]: 2026-03-09 18:25:13.56670574 +0000 UTC m=+5.050060335 container died d62561d9b74cff98629f6947346f36ae3219b14d5cf6b03d7456f0476f48bf9d (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6, CEPH_REF=squid, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-03-09T18:25:13.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:13 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:13.435+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:13.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:13 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:13.435+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.526791+0000 front 2026-03-09T18:24:43.526472+0000 (oldest deadline 2026-03-09T18:25:06.426377+0000) 2026-03-09T18:25:13.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:13 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:13.435+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6822 osd.2 since back 2026-03-09T18:24:47.527331+0000 front 2026-03-09T18:24:47.527236+0000 (oldest deadline 2026-03-09T18:25:13.426889+0000) 2026-03-09T18:25:14.111 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:13 vm03 podman[77664]: 2026-03-09 18:25:13.865476312 +0000 UTC m=+5.348830897 container remove d62561d9b74cff98629f6947346f36ae3219b14d5cf6b03d7456f0476f48bf9d (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, ceph=True, CEPH_REF=squid, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2026-03-09T18:25:14.112 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:13 vm03 bash[77664]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6 2026-03-09T18:25:14.112 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:14 vm03 podman[78157]: 2026-03-09 18:25:14.052827124 +0000 UTC m=+0.020065340 container create 9a08e47f96c68b1ccb26013660690efbe9f946c48b0b3a55f5cf4a7b7c033ae5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6-deactivate, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=squid, org.label-schema.vendor=CentOS, ceph=True) 2026-03-09T18:25:14.112 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:14 vm03 podman[78157]: 2026-03-09 18:25:14.098086904 +0000 UTC m=+0.065325129 container init 9a08e47f96c68b1ccb26013660690efbe9f946c48b0b3a55f5cf4a7b7c033ae5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6-deactivate, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=squid, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-03-09T18:25:14.112 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:14 vm03 podman[78157]: 2026-03-09 18:25:14.104803435 +0000 UTC m=+0.072041651 container start 9a08e47f96c68b1ccb26013660690efbe9f946c48b0b3a55f5cf4a7b7c033ae5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6-deactivate, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=squid, org.label-schema.vendor=CentOS, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2026-03-09T18:25:14.366 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:14 vm03 podman[78157]: 2026-03-09 18:25:14.106053165 +0000 UTC m=+0.073291381 container attach 9a08e47f96c68b1ccb26013660690efbe9f946c48b0b3a55f5cf4a7b7c033ae5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=squid, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-03-09T18:25:14.366 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:14 vm03 podman[78157]: 2026-03-09 18:25:14.044872975 +0000 UTC m=+0.012111200 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T18:25:14.366 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:14 vm03 conmon[78168]: conmon 9a08e47f96c68b1ccb26 : Failed to open cgroups file: /sys/fs/cgroup/machine.slice/libpod-9a08e47f96c68b1ccb26013660690efbe9f946c48b0b3a55f5cf4a7b7c033ae5.scope/memory.events 2026-03-09T18:25:14.366 INFO:journalctl@ceph.osd.6.vm03.stdout:Mar 09 18:25:14 vm03 podman[78157]: 2026-03-09 18:25:14.245874648 +0000 UTC m=+0.213112864 container died 9a08e47f96c68b1ccb26013660690efbe9f946c48b0b3a55f5cf4a7b7c033ae5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-6-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=squid, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2026-03-09T18:25:14.377 DEBUG:teuthology.orchestra.run.vm03:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.6.service' 2026-03-09T18:25:14.412 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:25:14.412 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-03-09T18:25:14.412 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-03-09T18:25:14.412 DEBUG:teuthology.orchestra.run.vm03:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.7 2026-03-09T18:25:14.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:14 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:14.482+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:14.754 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:14 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:14.482+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.526791+0000 front 2026-03-09T18:24:43.526472+0000 (oldest deadline 2026-03-09T18:25:06.426377+0000) 2026-03-09T18:25:14.754 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:14 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:14.482+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6822 osd.2 since back 2026-03-09T18:24:47.527331+0000 front 2026-03-09T18:24:47.527236+0000 (oldest deadline 2026-03-09T18:25:13.426889+0000) 2026-03-09T18:25:14.754 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:14 vm03 systemd[1]: Stopping Ceph osd.7 for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:25:14.754 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:14 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:14.577+0000 7fe001156640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T18:25:14.754 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:14 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:14.577+0000 7fe001156640 -1 osd.7 58 *** Got signal Terminated *** 2026-03-09T18:25:14.754 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:14 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:14.577+0000 7fe001156640 -1 osd.7 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-03-09T18:25:15.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:15 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:15.486+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:15.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:15 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:15.486+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.526791+0000 front 2026-03-09T18:24:43.526472+0000 (oldest deadline 2026-03-09T18:25:06.426377+0000) 2026-03-09T18:25:15.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:15 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:15.486+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6822 osd.2 since back 2026-03-09T18:24:47.527331+0000 front 2026-03-09T18:24:47.527236+0000 (oldest deadline 2026-03-09T18:25:13.426889+0000) 2026-03-09T18:25:16.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:16 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:16.482+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:16.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:16 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:16.482+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.526791+0000 front 2026-03-09T18:24:43.526472+0000 (oldest deadline 2026-03-09T18:25:06.426377+0000) 2026-03-09T18:25:16.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:16 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:16.482+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6822 osd.2 since back 2026-03-09T18:24:47.527331+0000 front 2026-03-09T18:24:47.527236+0000 (oldest deadline 2026-03-09T18:25:13.426889+0000) 2026-03-09T18:25:17.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:17 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:17.495+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:17.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:17 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:17.495+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.526791+0000 front 2026-03-09T18:24:43.526472+0000 (oldest deadline 2026-03-09T18:25:06.426377+0000) 2026-03-09T18:25:17.753 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:17 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:17.495+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6822 osd.2 since back 2026-03-09T18:24:47.527331+0000 front 2026-03-09T18:24:47.527236+0000 (oldest deadline 2026-03-09T18:25:13.426889+0000) 2026-03-09T18:25:18.253 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:17 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:17.983Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://192.168.123.102:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 192.168.123.102:8765: connect: connection refused" 2026-03-09T18:25:18.253 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:17 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:17.983Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://192.168.123.102:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 192.168.123.102:8765: connect: connection refused" 2026-03-09T18:25:18.253 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:17 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:17.989Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=nfs msg="Unable to refresh target groups" err="Get \"http://192.168.123.102:8765/sd/prometheus/sd-config?service=nfs\": dial tcp 192.168.123.102:8765: connect: connection refused" 2026-03-09T18:25:18.253 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:17 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:17.989Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://192.168.123.102:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 192.168.123.102:8765: connect: connection refused" 2026-03-09T18:25:19.003 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:18 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:18.501+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:19.003 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:18 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:18.501+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.526791+0000 front 2026-03-09T18:24:43.526472+0000 (oldest deadline 2026-03-09T18:25:06.426377+0000) 2026-03-09T18:25:19.003 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:18 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:18.501+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6822 osd.2 since back 2026-03-09T18:24:47.527331+0000 front 2026-03-09T18:24:47.527236+0000 (oldest deadline 2026-03-09T18:25:13.426889+0000) 2026-03-09T18:25:19.003 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:18 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:18.501+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6830 osd.3 since back 2026-03-09T18:24:53.427392+0000 front 2026-03-09T18:24:53.427474+0000 (oldest deadline 2026-03-09T18:25:17.527132+0000) 2026-03-09T18:25:19.912 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:19 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:19.531+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6806 osd.0 since back 2026-03-09T18:24:37.726222+0000 front 2026-03-09T18:24:37.726322+0000 (oldest deadline 2026-03-09T18:24:58.225651+0000) 2026-03-09T18:25:19.913 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:19 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:19.531+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6814 osd.1 since back 2026-03-09T18:24:43.526791+0000 front 2026-03-09T18:24:43.526472+0000 (oldest deadline 2026-03-09T18:25:06.426377+0000) 2026-03-09T18:25:19.913 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:19 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:19.531+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6822 osd.2 since back 2026-03-09T18:24:47.527331+0000 front 2026-03-09T18:24:47.527236+0000 (oldest deadline 2026-03-09T18:25:13.426889+0000) 2026-03-09T18:25:19.913 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:19 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7[70783]: 2026-03-09T18:25:19.531+0000 7fdffcf6e640 -1 osd.7 58 heartbeat_check: no reply from 192.168.123.102:6830 osd.3 since back 2026-03-09T18:24:53.427392+0000 front 2026-03-09T18:24:53.427474+0000 (oldest deadline 2026-03-09T18:25:17.527132+0000) 2026-03-09T18:25:19.913 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:19 vm03 podman[78280]: 2026-03-09 18:25:19.600641802 +0000 UTC m=+5.041771295 container stop cc3ac5882f275b6e2609fea832bb7e05dd8ee598b785979d7186ce242b9b14bf (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=squid, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-03-09T18:25:19.913 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:19 vm03 podman[78280]: 2026-03-09 18:25:19.63109663 +0000 UTC m=+5.072226123 container died cc3ac5882f275b6e2609fea832bb7e05dd8ee598b785979d7186ce242b9b14bf (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.vendor=CentOS, CEPH_REF=squid, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-03-09T18:25:19.913 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:19 vm03 podman[78280]: 2026-03-09 18:25:19.752425027 +0000 UTC m=+5.193554520 container remove cc3ac5882f275b6e2609fea832bb7e05dd8ee598b785979d7186ce242b9b14bf (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, CEPH_REF=squid, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2) 2026-03-09T18:25:19.913 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:19 vm03 bash[78280]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7 2026-03-09T18:25:20.212 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:19 vm03 podman[78357]: 2026-03-09 18:25:19.911439548 +0000 UTC m=+0.020187189 container create 79c29e294e4ecca884b1ada2e0341a4b0a83843f3b3450e8235c1424fe56183f (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, ceph=True, CEPH_REF=squid, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-03-09T18:25:20.213 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:19 vm03 podman[78357]: 2026-03-09 18:25:19.951488773 +0000 UTC m=+0.060236414 container init 79c29e294e4ecca884b1ada2e0341a4b0a83843f3b3450e8235c1424fe56183f (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, CEPH_REF=squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2026-03-09T18:25:20.213 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:19 vm03 podman[78357]: 2026-03-09 18:25:19.960053565 +0000 UTC m=+0.068801206 container start 79c29e294e4ecca884b1ada2e0341a4b0a83843f3b3450e8235c1424fe56183f (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7-deactivate, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, CEPH_REF=squid) 2026-03-09T18:25:20.213 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:19 vm03 podman[78357]: 2026-03-09 18:25:19.960908976 +0000 UTC m=+0.069656617 container attach 79c29e294e4ecca884b1ada2e0341a4b0a83843f3b3450e8235c1424fe56183f (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, CEPH_REF=squid, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0) 2026-03-09T18:25:20.213 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:20 vm03 podman[78357]: 2026-03-09 18:25:19.903632233 +0000 UTC m=+0.012379884 image pull 654f31e6858eb235bbece362255b685a945f2b6a367e2b88c4930c984fbb214c quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc 2026-03-09T18:25:20.213 INFO:journalctl@ceph.osd.7.vm03.stdout:Mar 09 18:25:20 vm03 podman[78357]: 2026-03-09 18:25:20.096200921 +0000 UTC m=+0.204948562 container died 79c29e294e4ecca884b1ada2e0341a4b0a83843f3b3450e8235c1424fe56183f (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-osd-7-deactivate, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, CEPH_REF=squid) 2026-03-09T18:25:20.239 DEBUG:teuthology.orchestra.run.vm03:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@osd.7.service' 2026-03-09T18:25:20.275 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:25:20.275 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-03-09T18:25:20.275 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2026-03-09T18:25:20.275 DEBUG:teuthology.orchestra.run.vm02:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@rgw.foo.a 2026-03-09T18:25:20.606 INFO:journalctl@ceph.rgw.foo.a.vm02.stdout:Mar 09 18:25:20 vm02 systemd[1]: Stopping Ceph rgw.foo.a for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:25:20.606 INFO:journalctl@ceph.rgw.foo.a.vm02.stdout:Mar 09 18:25:20 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-rgw-foo-a[74262]: 2026-03-09T18:25:20.392+0000 7f2d074f3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-03-09T18:25:20.606 INFO:journalctl@ceph.rgw.foo.a.vm02.stdout:Mar 09 18:25:20 vm02 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-rgw-foo-a[74262]: 2026-03-09T18:25:20.392+0000 7f2d0ad62980 -1 shutting down 2026-03-09T18:25:30.628 DEBUG:teuthology.orchestra.run.vm02:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@rgw.foo.a.service' 2026-03-09T18:25:30.658 INFO:journalctl@ceph.rgw.foo.a.vm02.stdout:Mar 09 18:25:30 vm02 bash[83693]: time="2026-03-09T18:25:30Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-rgw-foo-a in 10 seconds, resorting to SIGKILL" 2026-03-09T18:25:30.658 INFO:journalctl@ceph.rgw.foo.a.vm02.stdout:Mar 09 18:25:30 vm02 podman[83693]: 2026-03-09 18:25:30.429392526 +0000 UTC m=+10.054291311 container died a99a855520491ba2074f2c0376ca20877694540681d98e734150d9374a2418fd (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-rgw-foo-a, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.label-schema.schema-version=1.0) 2026-03-09T18:25:30.658 INFO:journalctl@ceph.rgw.foo.a.vm02.stdout:Mar 09 18:25:30 vm02 podman[83693]: 2026-03-09 18:25:30.558006865 +0000 UTC m=+10.182905650 container remove a99a855520491ba2074f2c0376ca20877694540681d98e734150d9374a2418fd (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-rgw-foo-a, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, OSD_FLAVOR=default, ceph=True, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, org.label-schema.license=GPLv2) 2026-03-09T18:25:30.658 INFO:journalctl@ceph.rgw.foo.a.vm02.stdout:Mar 09 18:25:30 vm02 bash[83693]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-rgw-foo-a 2026-03-09T18:25:30.658 INFO:journalctl@ceph.rgw.foo.a.vm02.stdout:Mar 09 18:25:30 vm02 systemd[1]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@rgw.foo.a.service: Main process exited, code=exited, status=137/n/a 2026-03-09T18:25:30.658 INFO:journalctl@ceph.rgw.foo.a.vm02.stdout:Mar 09 18:25:30 vm02 systemd[1]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@rgw.foo.a.service: Failed with result 'exit-code'. 2026-03-09T18:25:30.658 INFO:journalctl@ceph.rgw.foo.a.vm02.stdout:Mar 09 18:25:30 vm02 systemd[1]: Stopped Ceph rgw.foo.a for a3515824-1be4-11f1-b292-f5e4728bca3d. 2026-03-09T18:25:30.658 INFO:journalctl@ceph.rgw.foo.a.vm02.stdout:Mar 09 18:25:30 vm02 systemd[1]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@rgw.foo.a.service: Consumed 1.093s CPU time. 2026-03-09T18:25:30.669 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:25:30.669 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2026-03-09T18:25:30.669 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2026-03-09T18:25:30.669 DEBUG:teuthology.orchestra.run.vm03:> sudo systemctl stop ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@prometheus.a 2026-03-09T18:25:30.968 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:30 vm03 systemd[1]: Stopping Ceph prometheus.a for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:25:30.968 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:30 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:30.833Z caller=main.go:964 level=warn msg="Received SIGTERM, exiting gracefully..." 2026-03-09T18:25:30.968 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:30 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:30.833Z caller=main.go:988 level=info msg="Stopping scrape discovery manager..." 2026-03-09T18:25:30.968 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:30 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:30.833Z caller=main.go:1002 level=info msg="Stopping notify discovery manager..." 2026-03-09T18:25:30.968 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:30 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:30.833Z caller=manager.go:177 level=info component="rule manager" msg="Stopping rule manager..." 2026-03-09T18:25:30.969 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:30 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:30.833Z caller=main.go:984 level=info msg="Scrape discovery manager stopped" 2026-03-09T18:25:30.969 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:30 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:30.833Z caller=main.go:998 level=info msg="Notify discovery manager stopped" 2026-03-09T18:25:30.969 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:30 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:30.833Z caller=manager.go:187 level=info component="rule manager" msg="Rule manager stopped" 2026-03-09T18:25:30.969 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:30 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:30.833Z caller=main.go:1039 level=info msg="Stopping scrape manager..." 2026-03-09T18:25:30.969 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:30 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:30.834Z caller=main.go:1031 level=info msg="Scrape manager stopped" 2026-03-09T18:25:30.969 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:30 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:30.835Z caller=notifier.go:618 level=info component=notifier msg="Stopping notification manager..." 2026-03-09T18:25:30.969 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:30 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:30.835Z caller=main.go:1261 level=info msg="Notifier manager stopped" 2026-03-09T18:25:30.969 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:30 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a[74573]: ts=2026-03-09T18:25:30.835Z caller=main.go:1273 level=info msg="See you next time!" 2026-03-09T18:25:30.969 INFO:journalctl@ceph.prometheus.a.vm03.stdout:Mar 09 18:25:30 vm03 podman[78885]: 2026-03-09 18:25:30.846691908 +0000 UTC m=+0.048713175 container died 762a4dbba067dbc763dcfa59b4a26c7709b79a5bf98775e616a830562bf74904 (image=quay.io/prometheus/prometheus:v2.51.0, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-prometheus-a, maintainer=The Prometheus Authors ) 2026-03-09T18:25:31.067 DEBUG:teuthology.orchestra.run.vm03:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@prometheus.a.service' 2026-03-09T18:25:31.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-03-09T18:25:31.107 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2026-03-09T18:25:31.107 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a3515824-1be4-11f1-b292-f5e4728bca3d --force --keep-logs 2026-03-09T18:25:31.244 INFO:teuthology.orchestra.run.vm02.stdout:Deleting cluster with fsid: a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:25:33.494 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a3515824-1be4-11f1-b292-f5e4728bca3d --force --keep-logs 2026-03-09T18:25:33.642 INFO:teuthology.orchestra.run.vm03.stdout:Deleting cluster with fsid: a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:25:35.134 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:25:35 vm03 systemd[1]: Stopping Ceph iscsi.iscsi.a for a3515824-1be4-11f1-b292-f5e4728bca3d... 2026-03-09T18:25:35.503 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:25:35 vm03 ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a[73604]: debug Shutdown received 2026-03-09T18:25:45.442 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:25:45 vm03 bash[79428]: time="2026-03-09T18:25:45Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a in 10 seconds, resorting to SIGKILL" 2026-03-09T18:25:45.443 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:25:45 vm03 podman[79428]: 2026-03-09 18:25:45.151145499 +0000 UTC m=+10.040009972 container died bdef783e9e4bf8bd3139c7804975fd46aa6555cebbcabaa3a832b5ea73b3d82b (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=squid, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.label-schema.build-date=20260223) 2026-03-09T18:25:45.443 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:25:45 vm03 podman[79428]: 2026-03-09 18:25:45.274509345 +0000 UTC m=+10.163373818 container remove bdef783e9e4bf8bd3139c7804975fd46aa6555cebbcabaa3a832b5ea73b3d82b (image=quay.ceph.io/ceph-ci/ceph@sha256:8fda260ab1d2d3118a1622f7df75f44f285dfe74e71793626152a711c12bf2cc, name=ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, ceph=True, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e911bdebe5c8faa3800735d1568fcdca65db60df, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2) 2026-03-09T18:25:45.443 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:25:45 vm03 bash[79428]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d-iscsi-iscsi-a 2026-03-09T18:25:45.443 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:25:45 vm03 systemd[1]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2026-03-09T18:25:45.443 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:25:45 vm03 systemd[1]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2026-03-09T18:25:45.443 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:25:45 vm03 systemd[1]: Stopped Ceph iscsi.iscsi.a for a3515824-1be4-11f1-b292-f5e4728bca3d. 2026-03-09T18:25:45.443 INFO:journalctl@ceph.iscsi.iscsi.a.vm03.stdout:Mar 09 18:25:45 vm03 systemd[1]: ceph-a3515824-1be4-11f1-b292-f5e4728bca3d@iscsi.iscsi.a.service: Consumed 1.123s CPU time. 2026-03-09T18:25:46.686 DEBUG:teuthology.orchestra.run.vm02:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-03-09T18:25:46.718 DEBUG:teuthology.orchestra.run.vm03:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-03-09T18:25:46.749 INFO:tasks.cephadm:Archiving crash dumps... 2026-03-09T18:25:46.749 DEBUG:teuthology.misc:Transferring archived files from vm02:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/crash to /archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/603/remote/vm02/crash 2026-03-09T18:25:46.750 DEBUG:teuthology.orchestra.run.vm02:> sudo tar c -f - -C /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/crash -- . 2026-03-09T18:25:46.790 INFO:teuthology.orchestra.run.vm02.stderr:tar: /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/crash: Cannot open: No such file or directory 2026-03-09T18:25:46.790 INFO:teuthology.orchestra.run.vm02.stderr:tar: Error is not recoverable: exiting now 2026-03-09T18:25:46.792 DEBUG:teuthology.misc:Transferring archived files from vm03:/var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/crash to /archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/603/remote/vm03/crash 2026-03-09T18:25:46.792 DEBUG:teuthology.orchestra.run.vm03:> sudo tar c -f - -C /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/crash -- . 2026-03-09T18:25:46.823 INFO:teuthology.orchestra.run.vm03.stderr:tar: /var/lib/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/crash: Cannot open: No such file or directory 2026-03-09T18:25:46.823 INFO:teuthology.orchestra.run.vm03.stderr:tar: Error is not recoverable: exiting now 2026-03-09T18:25:46.825 INFO:tasks.cephadm:Checking cluster log for badness... 2026-03-09T18:25:46.825 DEBUG:teuthology.orchestra.run.vm02:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v MON_DOWN | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v CEPHADM_STRAY_DAEMON | egrep -v CEPHADM_FAILED_DAEMON | egrep -v CEPHADM_AGENT_DOWN | egrep -v PG_DEGRADED | head -n 1 2026-03-09T18:25:46.872 INFO:tasks.cephadm:Compressing logs... 2026-03-09T18:25:46.872 DEBUG:teuthology.orchestra.run.vm02:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-03-09T18:25:46.914 DEBUG:teuthology.orchestra.run.vm03:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-03-09T18:25:46.940 INFO:teuthology.orchestra.run.vm02.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-03-09T18:25:46.940 INFO:teuthology.orchestra.run.vm02.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-03-09T18:25:46.941 INFO:teuthology.orchestra.run.vm02.stderr:gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mon.a.log 2026-03-09T18:25:46.942 INFO:teuthology.orchestra.run.vm03.stderr:find: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-03-09T18:25:46.942 INFO:teuthology.orchestra.run.vm03.stderr:‘/var/log/rbd-target-api’: No such file or directory 2026-03-09T18:25:46.942 INFO:teuthology.orchestra.run.vm02.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.log 2026-03-09T18:25:46.943 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mon.b.log 2026-03-09T18:25:46.943 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-volume.log 2026-03-09T18:25:46.944 INFO:teuthology.orchestra.run.vm02.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mon.a.log: 86.2% -- replaced with /var/log/ceph/cephadm.log.gz 2026-03-09T18:25:46.944 INFO:teuthology.orchestra.run.vm02.stderr:gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.audit.log 2026-03-09T18:25:46.945 INFO:teuthology.orchestra.run.vm02.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.log: 90.9% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.log.gz 2026-03-09T18:25:46.945 INFO:teuthology.orchestra.run.vm02.stderr:gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mgr.y.log 2026-03-09T18:25:46.945 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mon.b.log: 82.4% -- replaced with /var/log/ceph/cephadm.log.gz 2026-03-09T18:25:46.946 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.cephadm.log 2026-03-09T18:25:46.947 INFO:teuthology.orchestra.run.vm02.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.audit.log: 94.0% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.audit.log.gz 2026-03-09T18:25:46.947 INFO:teuthology.orchestra.run.vm02.stderr:gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.cephadm.log 2026-03-09T18:25:46.951 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.audit.log 2026-03-09T18:25:46.952 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.cephadm.log: 80.6% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.cephadm.log.gz 2026-03-09T18:25:46.956 INFO:teuthology.orchestra.run.vm02.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-volume.log 2026-03-09T18:25:46.956 INFO:teuthology.orchestra.run.vm02.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.cephadm.log: 88.7% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.cephadm.log.gz 2026-03-09T18:25:46.957 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.log 2026-03-09T18:25:46.957 INFO:teuthology.orchestra.run.vm02.stderr:gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mon.c.log 2026-03-09T18:25:46.959 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.audit.log: 90.5% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.audit.log.gz 2026-03-09T18:25:46.959 INFO:teuthology.orchestra.run.vm03.stderr: 96.1% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-volume.log.gz 2026-03-09T18:25:46.959 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mgr.x.log 2026-03-09T18:25:46.960 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.log: 83.9% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph.log.gz 2026-03-09T18:25:46.960 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.4.log 2026-03-09T18:25:46.964 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mgr.x.log: 90.1% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mgr.x.log.gz 2026-03-09T18:25:46.964 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.5.log 2026-03-09T18:25:46.971 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.6.log 2026-03-09T18:25:46.972 INFO:teuthology.orchestra.run.vm02.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.0.log 2026-03-09T18:25:46.981 INFO:teuthology.orchestra.run.vm02.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.1.log 2026-03-09T18:25:46.985 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.7.log 2026-03-09T18:25:46.986 INFO:teuthology.orchestra.run.vm02.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.2.log 2026-03-09T18:25:46.988 INFO:teuthology.orchestra.run.vm02.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.1.log: 96.1% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-volume.log.gz 2026-03-09T18:25:46.991 INFO:teuthology.orchestra.run.vm02.stderr:gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.3.log 2026-03-09T18:25:46.992 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/tcmu-runner.log 2026-03-09T18:25:46.997 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.7.log: 92.1% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mon.b.log.gz 2026-03-09T18:25:46.997 INFO:teuthology.orchestra.run.vm03.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/tcmu-runner.log: 63.3% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/tcmu-runner.log.gz 2026-03-09T18:25:47.007 INFO:teuthology.orchestra.run.vm02.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-client.rgw.foo.a.log 2026-03-09T18:25:47.011 INFO:teuthology.orchestra.run.vm02.stderr:/var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.3.log: /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-client.rgw.foo.a.log: 59.3% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-client.rgw.foo.a.log.gz 2026-03-09T18:25:47.074 INFO:teuthology.orchestra.run.vm03.stderr: 93.7% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.7.log.gz 2026-03-09T18:25:47.109 INFO:teuthology.orchestra.run.vm03.stderr: 93.5% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.5.log.gz 2026-03-09T18:25:47.125 INFO:teuthology.orchestra.run.vm02.stderr: 92.0% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mon.c.log.gz 2026-03-09T18:25:47.127 INFO:teuthology.orchestra.run.vm02.stderr: 88.6% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mgr.y.log.gz 2026-03-09T18:25:47.128 INFO:teuthology.orchestra.run.vm03.stderr: 93.6% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.6.log.gz 2026-03-09T18:25:47.143 INFO:teuthology.orchestra.run.vm03.stderr: 93.9% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.4.log.gz 2026-03-09T18:25:47.145 INFO:teuthology.orchestra.run.vm03.stderr: 2026-03-09T18:25:47.145 INFO:teuthology.orchestra.run.vm03.stderr:real 0m0.214s 2026-03-09T18:25:47.145 INFO:teuthology.orchestra.run.vm03.stderr:user 0m0.364s 2026-03-09T18:25:47.145 INFO:teuthology.orchestra.run.vm03.stderr:sys 0m0.039s 2026-03-09T18:25:47.151 INFO:teuthology.orchestra.run.vm02.stderr: 93.4% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.2.log.gz 2026-03-09T18:25:47.212 INFO:teuthology.orchestra.run.vm02.stderr: 93.8% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.0.log.gz 2026-03-09T18:25:47.216 INFO:teuthology.orchestra.run.vm02.stderr: 91.5% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-mon.a.log.gz 2026-03-09T18:25:47.239 INFO:teuthology.orchestra.run.vm02.stderr: 93.9% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.1.log.gz 2026-03-09T18:25:47.241 INFO:teuthology.orchestra.run.vm02.stderr: 93.8% -- replaced with /var/log/ceph/a3515824-1be4-11f1-b292-f5e4728bca3d/ceph-osd.3.log.gz 2026-03-09T18:25:47.243 INFO:teuthology.orchestra.run.vm02.stderr: 2026-03-09T18:25:47.243 INFO:teuthology.orchestra.run.vm02.stderr:real 0m0.313s 2026-03-09T18:25:47.243 INFO:teuthology.orchestra.run.vm02.stderr:user 0m0.557s 2026-03-09T18:25:47.243 INFO:teuthology.orchestra.run.vm02.stderr:sys 0m0.053s 2026-03-09T18:25:47.243 INFO:tasks.cephadm:Archiving logs... 2026-03-09T18:25:47.244 DEBUG:teuthology.misc:Transferring archived files from vm02:/var/log/ceph to /archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/603/remote/vm02/log 2026-03-09T18:25:47.244 DEBUG:teuthology.orchestra.run.vm02:> sudo tar c -f - -C /var/log/ceph -- . 2026-03-09T18:25:47.348 DEBUG:teuthology.misc:Transferring archived files from vm03:/var/log/ceph to /archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/603/remote/vm03/log 2026-03-09T18:25:47.348 DEBUG:teuthology.orchestra.run.vm03:> sudo tar c -f - -C /var/log/ceph -- . 2026-03-09T18:25:47.394 INFO:tasks.cephadm:Removing cluster... 2026-03-09T18:25:47.394 DEBUG:teuthology.orchestra.run.vm02:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a3515824-1be4-11f1-b292-f5e4728bca3d --force 2026-03-09T18:25:47.533 INFO:teuthology.orchestra.run.vm02.stdout:Deleting cluster with fsid: a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:25:47.643 DEBUG:teuthology.orchestra.run.vm03:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a3515824-1be4-11f1-b292-f5e4728bca3d --force 2026-03-09T18:25:47.783 INFO:teuthology.orchestra.run.vm03.stdout:Deleting cluster with fsid: a3515824-1be4-11f1-b292-f5e4728bca3d 2026-03-09T18:25:47.890 INFO:tasks.cephadm:Removing cephadm ... 2026-03-09T18:25:47.890 DEBUG:teuthology.orchestra.run.vm02:> rm -rf /home/ubuntu/cephtest/cephadm 2026-03-09T18:25:47.909 DEBUG:teuthology.orchestra.run.vm03:> rm -rf /home/ubuntu/cephtest/cephadm 2026-03-09T18:25:47.929 INFO:tasks.cephadm:Teardown complete 2026-03-09T18:25:47.929 DEBUG:teuthology.run_tasks:Unwinding manager nvme_loop 2026-03-09T18:25:47.931 INFO:tasks.nvme_loop:Disconnecting nvme_loop vm02:/dev/vdb... 2026-03-09T18:25:47.931 DEBUG:teuthology.orchestra.run.vm02:> sudo nvme disconnect -n vdb 2026-03-09T18:25:48.044 INFO:teuthology.orchestra.run.vm02.stdout:NQN:vdb disconnected 1 controller(s) 2026-03-09T18:25:48.045 INFO:tasks.nvme_loop:Disconnecting nvme_loop vm02:/dev/vdc... 2026-03-09T18:25:48.045 DEBUG:teuthology.orchestra.run.vm02:> sudo nvme disconnect -n vdc 2026-03-09T18:25:48.138 INFO:teuthology.orchestra.run.vm02.stdout:NQN:vdc disconnected 1 controller(s) 2026-03-09T18:25:48.140 INFO:tasks.nvme_loop:Disconnecting nvme_loop vm02:/dev/vdd... 2026-03-09T18:25:48.140 DEBUG:teuthology.orchestra.run.vm02:> sudo nvme disconnect -n vdd 2026-03-09T18:25:48.241 INFO:teuthology.orchestra.run.vm02.stdout:NQN:vdd disconnected 1 controller(s) 2026-03-09T18:25:48.244 INFO:tasks.nvme_loop:Disconnecting nvme_loop vm02:/dev/vde... 2026-03-09T18:25:48.244 DEBUG:teuthology.orchestra.run.vm02:> sudo nvme disconnect -n vde 2026-03-09T18:25:48.350 INFO:teuthology.orchestra.run.vm02.stdout:NQN:vde disconnected 1 controller(s) 2026-03-09T18:25:48.352 DEBUG:teuthology.orchestra.run.vm02:> set -ex 2026-03-09T18:25:48.352 DEBUG:teuthology.orchestra.run.vm02:> sudo dd of=/scratch_devs 2026-03-09T18:25:48.381 INFO:tasks.nvme_loop:Disconnecting nvme_loop vm03:/dev/vdb... 2026-03-09T18:25:48.381 DEBUG:teuthology.orchestra.run.vm03:> sudo nvme disconnect -n vdb 2026-03-09T18:25:48.466 INFO:teuthology.orchestra.run.vm03.stdout:NQN:vdb disconnected 1 controller(s) 2026-03-09T18:25:48.468 INFO:tasks.nvme_loop:Disconnecting nvme_loop vm03:/dev/vdc... 2026-03-09T18:25:48.468 DEBUG:teuthology.orchestra.run.vm03:> sudo nvme disconnect -n vdc 2026-03-09T18:25:48.571 INFO:teuthology.orchestra.run.vm03.stdout:NQN:vdc disconnected 1 controller(s) 2026-03-09T18:25:48.573 INFO:tasks.nvme_loop:Disconnecting nvme_loop vm03:/dev/vdd... 2026-03-09T18:25:48.573 DEBUG:teuthology.orchestra.run.vm03:> sudo nvme disconnect -n vdd 2026-03-09T18:25:48.663 INFO:teuthology.orchestra.run.vm03.stdout:NQN:vdd disconnected 1 controller(s) 2026-03-09T18:25:48.666 INFO:tasks.nvme_loop:Disconnecting nvme_loop vm03:/dev/vde... 2026-03-09T18:25:48.666 DEBUG:teuthology.orchestra.run.vm03:> sudo nvme disconnect -n vde 2026-03-09T18:25:48.757 INFO:teuthology.orchestra.run.vm03.stdout:NQN:vde disconnected 1 controller(s) 2026-03-09T18:25:48.759 DEBUG:teuthology.orchestra.run.vm03:> set -ex 2026-03-09T18:25:48.759 DEBUG:teuthology.orchestra.run.vm03:> sudo dd of=/scratch_devs 2026-03-09T18:25:48.788 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-03-09T18:25:48.790 INFO:teuthology.task.clock:Checking final clock skew... 2026-03-09T18:25:48.790 DEBUG:teuthology.orchestra.run.vm02:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-09T18:25:48.792 DEBUG:teuthology.orchestra.run.vm03:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-03-09T18:25:48.806 INFO:teuthology.orchestra.run.vm02.stderr:bash: line 1: ntpq: command not found 2026-03-09T18:25:48.845 INFO:teuthology.orchestra.run.vm03.stderr:bash: line 1: ntpq: command not found 2026-03-09T18:25:48.905 INFO:teuthology.orchestra.run.vm03.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-09T18:25:48.905 INFO:teuthology.orchestra.run.vm03.stdout:=============================================================================== 2026-03-09T18:25:48.905 INFO:teuthology.orchestra.run.vm03.stdout:^- www.festibal.de 2 6 377 6 -2760us[-2759us] +/- 76ms 2026-03-09T18:25:48.905 INFO:teuthology.orchestra.run.vm03.stdout:^* ntp01.pingless.com 2 6 377 5 -799us[ -798us] +/- 14ms 2026-03-09T18:25:48.905 INFO:teuthology.orchestra.run.vm03.stdout:^+ static.46.170.245.188.cl> 3 6 377 6 -771us[ -770us] +/- 17ms 2026-03-09T18:25:48.905 INFO:teuthology.orchestra.run.vm03.stdout:^+ 172-104-154-182.ip.linod> 2 6 377 7 +3163us[+3164us] +/- 31ms 2026-03-09T18:25:48.905 INFO:teuthology.orchestra.run.vm02.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-03-09T18:25:48.905 INFO:teuthology.orchestra.run.vm02.stdout:=============================================================================== 2026-03-09T18:25:48.905 INFO:teuthology.orchestra.run.vm02.stdout:^* ntp01.pingless.com 2 6 377 6 -732us[ -741us] +/- 14ms 2026-03-09T18:25:48.905 INFO:teuthology.orchestra.run.vm02.stdout:^+ static.46.170.245.188.cl> 3 6 377 6 -817us[ -817us] +/- 17ms 2026-03-09T18:25:48.905 INFO:teuthology.orchestra.run.vm02.stdout:^+ 172-104-154-182.ip.linod> 2 6 377 7 +3880us[+3871us] +/- 32ms 2026-03-09T18:25:48.905 INFO:teuthology.orchestra.run.vm02.stdout:^- www.festibal.de 2 6 377 6 -2809us[-2809us] +/- 76ms 2026-03-09T18:25:48.906 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-03-09T18:25:48.908 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-03-09T18:25:48.908 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-03-09T18:25:48.910 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-03-09T18:25:48.912 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-03-09T18:25:48.914 INFO:teuthology.task.internal:Duration was 474.546560 seconds 2026-03-09T18:25:48.914 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-03-09T18:25:48.917 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-03-09T18:25:48.917 DEBUG:teuthology.orchestra.run.vm02:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-03-09T18:25:48.948 DEBUG:teuthology.orchestra.run.vm03:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-03-09T18:25:48.983 INFO:teuthology.orchestra.run.vm02.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-09T18:25:48.992 INFO:teuthology.orchestra.run.vm03.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-03-09T18:25:49.385 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-03-09T18:25:49.385 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@vm02.local 2026-03-09T18:25:49.386 DEBUG:teuthology.orchestra.run.vm02:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-03-09T18:25:49.449 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@vm03.local 2026-03-09T18:25:49.449 DEBUG:teuthology.orchestra.run.vm03:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-03-09T18:25:49.473 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-03-09T18:25:49.473 DEBUG:teuthology.orchestra.run.vm02:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-03-09T18:25:49.490 DEBUG:teuthology.orchestra.run.vm03:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-03-09T18:25:49.976 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-03-09T18:25:49.976 DEBUG:teuthology.orchestra.run.vm02:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-03-09T18:25:49.978 DEBUG:teuthology.orchestra.run.vm03:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-03-09T18:25:50.002 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-09T18:25:50.002 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-09T18:25:50.002 INFO:teuthology.orchestra.run.vm03.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-03-09T18:25:50.003 INFO:teuthology.orchestra.run.vm03.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-03-09T18:25:50.003 INFO:teuthology.orchestra.run.vm03.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/journalctl.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-03-09T18:25:50.006 INFO:teuthology.orchestra.run.vm02.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-03-09T18:25:50.006 INFO:teuthology.orchestra.run.vm02.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-03-09T18:25:50.006 INFO:teuthology.orchestra.run.vm02.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-03-09T18:25:50.007 INFO:teuthology.orchestra.run.vm02.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-03-09T18:25:50.007 INFO:teuthology.orchestra.run.vm02.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-03-09T18:25:50.151 INFO:teuthology.orchestra.run.vm02.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 97.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-03-09T18:25:50.156 INFO:teuthology.orchestra.run.vm03.stderr: 98.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-03-09T18:25:50.158 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-03-09T18:25:50.160 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-03-09T18:25:50.160 DEBUG:teuthology.orchestra.run.vm02:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-03-09T18:25:50.222 DEBUG:teuthology.orchestra.run.vm03:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-03-09T18:25:50.252 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-03-09T18:25:50.254 DEBUG:teuthology.orchestra.run.vm02:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-03-09T18:25:50.264 DEBUG:teuthology.orchestra.run.vm03:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-03-09T18:25:50.292 INFO:teuthology.orchestra.run.vm02.stdout:kernel.core_pattern = core 2026-03-09T18:25:50.322 INFO:teuthology.orchestra.run.vm03.stdout:kernel.core_pattern = core 2026-03-09T18:25:50.336 DEBUG:teuthology.orchestra.run.vm02:> test -e /home/ubuntu/cephtest/archive/coredump 2026-03-09T18:25:50.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T18:25:50.367 DEBUG:teuthology.orchestra.run.vm03:> test -e /home/ubuntu/cephtest/archive/coredump 2026-03-09T18:25:50.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-03-09T18:25:50.389 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-03-09T18:25:50.392 INFO:teuthology.task.internal:Transferring archived files... 2026-03-09T18:25:50.392 DEBUG:teuthology.misc:Transferring archived files from vm02:/home/ubuntu/cephtest/archive to /archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/603/remote/vm02 2026-03-09T18:25:50.392 DEBUG:teuthology.orchestra.run.vm02:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-03-09T18:25:50.441 DEBUG:teuthology.misc:Transferring archived files from vm03:/home/ubuntu/cephtest/archive to /archive/kyr-2026-03-09_11:23:05-orch-squid-none-default-vps/603/remote/vm03 2026-03-09T18:25:50.441 DEBUG:teuthology.orchestra.run.vm03:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-03-09T18:25:50.468 INFO:teuthology.task.internal:Removing archive directory... 2026-03-09T18:25:50.468 DEBUG:teuthology.orchestra.run.vm02:> rm -rf -- /home/ubuntu/cephtest/archive 2026-03-09T18:25:50.483 DEBUG:teuthology.orchestra.run.vm03:> rm -rf -- /home/ubuntu/cephtest/archive 2026-03-09T18:25:50.527 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-03-09T18:25:50.539 INFO:teuthology.task.internal:Not uploading archives. 2026-03-09T18:25:50.539 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-03-09T18:25:50.542 INFO:teuthology.task.internal:Tidying up after the test... 2026-03-09T18:25:50.543 DEBUG:teuthology.orchestra.run.vm02:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-03-09T18:25:50.545 DEBUG:teuthology.orchestra.run.vm03:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-03-09T18:25:50.563 INFO:teuthology.orchestra.run.vm02.stdout: 8532144 0 drwxr-xr-x 2 ubuntu ubuntu 6 Mar 9 18:25 /home/ubuntu/cephtest 2026-03-09T18:25:50.585 INFO:teuthology.orchestra.run.vm03.stdout: 8532145 0 drwxr-xr-x 2 ubuntu ubuntu 6 Mar 9 18:25 /home/ubuntu/cephtest 2026-03-09T18:25:50.586 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-03-09T18:25:50.608 INFO:teuthology.run:Summary data: description: orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} duration: 474.54655957221985 owner: kyr success: true 2026-03-09T18:25:50.616 DEBUG:teuthology.report:Pushing job info to http://localhost:8080 2026-03-09T18:25:50.705 INFO:teuthology.run:pass